This study examined the association of infants' sustained social withdrawal with parents' self-reported current depressive symptoms and perceived mental health. Two hundred and sixty infants aged 4, 8 and 18 months were examined with the Baby Alarm Distress Scale (ADBB). Parents' depressive symptoms and perceived mental health during the preceding year were elicited through questionnaires. Mother's current depressive symptoms and father's perceived moderate or poor mental health during the preceding year both independently increased the infant's risk of withdrawal. When both parents had mental health problems, the infant was more likely to be withdrawn. Infant's social withdrawal should alert clinicians to examine parental mental health. Also, if the parent has mental health problems, the infant's social behavior and possible withdrawal should be examined. Families where both parents experience poor mental health should be identified, and treated, while the infants of these families in particular seem to be at risk for social withdrawal.