Along with many of the genome-wide transitions in chromatin composition throughout spermatogenesis, epigenetic modifications on histone tails and DNA are continuously modified to ensure stage specific gene expression in the maturing spermatid. Recent findings have suggested that the repertoire of epigenetic modifications in the mature sperm may have a potential role in the developing embryo and alterations in the epigenetic profile have been associated with infertility. These changes include DNA demethylation and the retention of modified histones at important developmental, signaling and micro-RNA genes, which resemble the epigenetic state of an embryonic stem cell. This review assesses the significance of epigenetic changes during spermatogenesis, and provides insight on recent associations made between altered epigenetic profiles in the mature sperm and its relationship to infertility.