Previous studies have shown that the gene encoding the adhesion G protein-coupled receptor L3 (ADGRL3; formerly latrophilin 3, LPHN3) is associated with Attention-Deficit/Hyperactivity Disorder (ADHD). Conversely, no studies have investigated the anatomical or functional brain substrates of ADGRL3 risk variants. We examined here whether individuals with different ADGRL3 haplotypes, including both patients with ADHD and healthy controls, showed differences in brain anatomy and function. We recruited and genotyped adult patients with combined type ADHD and healthy controls to achieve a sample balanced for age, sex, premorbid IQ, and three ADGRL3 haplotype groups (risk, protective, and others). The final sample (n = 128) underwent structural and functional brain imaging (voxel-based morphometry and n-back working memory fMRI). We analyzed the brain structural and functional effects of ADHD, haplotypes, and their interaction, covarying for age, sex, and medication. Individuals (patients or controls) with the protective haplotype showed strong, widespread hypo-activation in the frontal cortex extending to inferior temporal and fusiform gyri. Individuals (patients or controls) with the risk haplotype also showed hypo-activation, more focused in the right temporal cortex. Patients showed parietal hyper-activation. Disorder-haplotype interactions, as well as structural findings, were not statistically significant. To sum up, both protective and risk ADGRL3 haplotypes are associated with substantial brain hypo-activation during working memory tasks, stressing this gene's relevance in cognitive brain function. Conversely, we did not find brain effects of the interactions between adult ADHD and ADGRL3 haplotypes.