While there have been a vast number of studies on bacterial alpha diversity in the shallow terrestrial subsurface, beta diversity - how the bacterial community composition changes with spatial distance - has received surprisingly limited attention. Here, bacterial beta diversity and its controlling factors are investigated by denaturing gradient gel electrophoresis and cloning of samples from a 700-cm-long sediment core, the lower half of which consisted of marine-originated sediments. According to canonical correspondence analysis with variation partitioning, contemporary environmental variables explain beta diversity in a greater proportion than depth. However, we also found that community similarity decayed significantly with spatial distance and the slopes of the distance-decay relationships are relatively high. The high beta diversity indicates that the bacterial distribution patterns are not only controlled by contemporary environments, but also related to historical events, that is, dispersal or depositional history. This is highlighted by the different beta diversity patterns among studied sediment layers. We thus conclude that the high beta diversity in the shallow terrestrial subsurface is a trade-off between historical events and environmental heterogeneity. Furthermore, we suggest that the high beta diversity of bacteria is likely to be recapitulated in other terrestrial sites because of the great frequency of high geochemical and/or historical variations along depth.