The diversity of bacterial communities at three sites impacted by acid mine drainage (AMD) from the Yinshan Mine in China was studied using comparative sequence analysis of two molecular markers, the 16S rRNA and gyrB genes. The phylogenetic analyses retrieved sequences from six classes of bacteria, Nitrospira, Alphaproteobacteria, Gammaproteobacteria, Deltaproteobacteria, Acidobacteria, and Actinobacteria, as well as sequences related to the plastid of the cyanobacterium Cyanidium acidocaldarium and also some unknown bacteria. The results of phylogenetic analyses based on gyrB and 16S rRNA were compared. This confirmed that gyrB gene analysis may be a useful tool, in addition to the comparative sequence analysis of the 16S rRNA gene, for the analysis of microbial community compositions. Moreover, the Mantel test showed that the geochemical characteristics, especially the pH value and the concentration of iron, strongly influenced the composition of the microbial communities.