Community level physiological profiling and pyrosequencing-based analysis of the V1-V2 16S rRNA gene region were used to characterize and compare microbial community structure, diversity, and bacterial phylogeny from soils of chemically cultivated land (CCL), organically cultivated land (OCL), and fallow grass land (FGL) for 16 years and were under three different land use types. The entire dataset comprised of 16,608 good-quality sequences (CCL, 6,379; OCL, 4,835; FGL, 5,394); among them 12,606 sequences could be classified in 15 known phylum. The most abundant phylum were Proteobacteria (29.8%), Acidobacteria (22.6%), Actinobacteria (11.1%), and Bacteroidetes (4.7%), while 24.3% of the sequences were from bacterial domain but could not be further classified to any known phylum. Proteobacteria, Bacteroidetes, and Gemmatimonadetes were found to be significantly abundant in OCL soil. On the contrary, Actinobacteria and Acidobacteria were significantly abundant in CCL and FGL, respectively. Our findings supported the view that organic compost amendment (OCL) activates diverse group of microorganisms as compared with conventionally used synthetic chemical fertilizers. Functional diversity and evenness based on carbon source utilization pattern was significantly higher in OCL as compared to CCL and FGL, suggesting an improvement in soil quality. This abundance of microbes possibly leads to the enhanced level of soil organic carbon, soil organic nitrogen, and microbial biomass in OCL and FGL soils as collated with CCL. This work increases our current understanding on the effect of long-term organic and chemical amendment applications on abundance, diversity, and composition of bacterial community inhabiting the soil for the prospects of agricultural yield and quantity of soil.