Persistent central nervous system (CNS) immune dysregulation and consequent dysfunction of multiple neural cell types is central to the neurobiological underpinnings of a cognitive impairment syndrome that can occur following traditional cancer therapies or certain infections. Immunotherapies have revolutionized cancer care for many tumor types, but the potential long-term cognitive sequelae are incompletely understood. Here, we demonstrate in mouse models that chimeric antigen receptor (CAR) T cell therapy for both CNS and non-CNS cancers can impair cognitive function and induce a persistent CNS immune response characterized by white matter microglial reactivity and elevated cerebrospinal fluid (CSF) cytokines and chemokines. Consequently, oligodendroglial homeostasis and hippocampal neurogenesis are disrupted. Microglial depletion rescues oligodendroglial deficits and cognitive performance in a behavioral test of attention and short-term memory function. Taken together, these findings illustrate similar mechanisms underlying immunotherapy-related cognitive impairment (IRCI) and cognitive impairment following traditional cancer therapies and other immune challenges.