Histone modifications play an important role in eukaryotic gene regulation. However, the dynamic alteration of histone modification during development is poorly understood. In addition, the relationship between histone modification and globin gene switching remains unclear. Here, we assessed the dynamic pattern of histone modification (H3 acetylation, H4 acetylation, H3 K4 methylation, and H3 K79 methylation) along the murine alpha-globin locus, as well as along the human alpha-globin locus in transgenic mice, during globin gene switching in vivo. During the switching, histone modification at embryonic zeta-gene and fetal/adult alpha-genes displayed different developmental patterns. The level of histone modification at zeta-gene was developmentally regulated, in accordance with the level of zeta-gene expression, whereas the alpha-genes kept high level of histone modification at both developmental stages, regardless of their expression levels. Histone deacetylase inhibition selectively increased acetylation at the inactive zeta-gene in fetal livers, although it did not reactivate the gene expression. More importantly, an obvious increasing of histone modification level at major regulatory elements and fetal/adult alpha-genes was observed during the switching, suggesting that a conserved, extended chromatin opening within the locus occurs during globin gene switching.