Bone mineral density (BMD), a risk factor for osteoporosis, is believed to be under genetic control. The effect of environmental factors and gender on the heritability of BMD and bone size is ill-defined. In this study, heritability estimates (h2) were determined in 3,320 southern Chinese subjects from 1,019 families using the variance components model. The h2 for age, weight and height-adjusted BMD was 0.63-0.71 for females, and 0.74-0.79 for males; and for bone size, 0.44-0.64 for females and 0.32-0.86 for males. Adjustment for lifestyle factors including calcium and phytoestrogen intake, exercise, smoking and alcohol consumption altered the h2 differently in males and females. The proportion of variance in BMD and bone size explained by all covariates varied between skeletal sites, but was consistently greater in females than males. A significant gender difference was observed in the genetic variance of BMD and bone size at the hip but not the spine. In conclusion, a gender difference was observed in the degree of heritability of BMD and bone size at specific skeletal sites. Environmental influences contributed variably at different sites in the two sexes.