Objectives: Nonresponse can bias prevalence estimates in population surveys. Effects of selective participation in behavior change intervention trials have been little studied. We tested hypotheses that trial participants who are hard to recruit are (1) more likely to be lost-to-follow-up and (2) less responsive to intervention.
Study design and setting: We undertook a two-stage individual participant data meta-analysis of four alcohol intervention trials involving 9,251 university students in Australia, New Zealand, and Sweden, comparing participants who enrolled "late" (after the final invitation to participate) vs. "early" (before that). Outcomes were whether participants completed assessments at each trial's primary endpoint (late/early) and number of drinks consumed per week (intervention/control) among late enrolees vs. early enrolees.
Results: Late enrolees were more likely to be lost-to-follow-up than early enrolees (OR 2.3, 95% CI: 1.7, 2.9). Intervention effect estimates were smaller for late vs. early enrolees, but not significantly so (RR = 0.93; 95% CI: 0.79, 1.08).
Conclusion: Greater effort to recruit trial participants was associated with higher attrition, but there was no clear evidence of bias in effect estimation. The possibility that intervention effect estimates do not generalize beyond a relatively compliant minority of trial participants may warrant further study.
Keywords: Bias; External validity; Generalizability; Intervention trial; Nonresponse; Selection.
Copyright © 2019. Published by Elsevier Inc.