Apolipoprotein E (APOE) increases the risk for Alzheimer’s disease (ɛ4 allele) and cerebral amyloid angiopathy (ɛ2 and ɛ4), but its role in small vessel disease (SVD) is debated. Here we studied the effects of APOE on white matter hyperintensity volume (WMHV) in CADASIL (cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy), a nonamyloidogenic angiopathy and inherited early-onset form of pure SVD. Four hundred and eighty-eight subjects were recruited through a multicenter consortium. Compared with APOE ɛ3/ɛ3, WMHV was increased in APOE ɛ2 (P = 0.02) but not APOE ɛ4. The results remained significant when controlled for genome-wide genetic background variation. Our findings suggest a modifying influence of APOE ɛ2 on WMHV caused by pure SVD.