Epigenetics is the link between the genome and environment, which can respond to physiological (such as age) or environmental factors (such as diet, stress, and pollution) and induce changes in epigenetic modifications (such as DNA methylation, non-coding RNA, and histone modifications). It can also serve as cellular memory transmitted from generation to generation. Sperm is highly responsive to such environmental changes and has unique epigenetic profiles. The paternal inter-/trans-generational inheritance mediated by sperm epigenetic changes is closely related to the health of offspring, which is an issue of great concern. This review has summarized the epigenetic mechanisms of paternal inter-/trans-generational inheritance and recent studies on the paternal inheritance mediated by sperm epigenetic changes in human and mice, which may facilitate understanding of the relationship between paternal epigenetic changes and the health of offspring caused by physiological or environmental changes and provide a basis for genetic counseling and clinical intervention.