Alzheimer's disease (AD) heritability is enriched in glial genes, but how and when cell-type-specific genetic risk contributes to AD remains unclear. Here, we derive cell-type-specific AD polygenic risk scores (ADPRS) from two extensively characterized datasets. In an autopsy dataset spanning all stages of AD (n=1,457), astrocytic (Ast) ADPRS was associated with both diffuse and neuritic Aβ plaques, while microglial (Mic) ADPRS was associated with neuritic Aβ plaques, microglial activation, tau, and cognitive decline. Causal modeling analyses further clarified these relationships. In an independent neuroimaging dataset of cognitively unimpaired elderly (n=2,921), Ast-ADPRS were associated with Aβ, and Mic-ADPRS was associated with Aβ and tau, showing a consistent pattern with the autopsy dataset. Oligodendrocytic and excitatory neuronal ADPRSs were associated with tau, but only in the autopsy dataset including symptomatic AD cases. Together, our study provides human genetic evidence implicating multiple glial cell types in AD pathophysiology, starting from the preclinical stage.