The formation of neurofibrillary tangles is believed to contribute to the neurodegeneration observed in Alzheimer's disease (AD). Postmortem studies have shown strong associations between the neurofibrillary pathology and both neuronal loss and the severity of cognitive impairment. However, the temporal changes in the neurofibrillary pathology and its association with the progression of the disease are not well understood. Tau positron emission tomography (PET) imaging is expected to be useful for the longitudinal assessment of neurofibrillary pathology in the living brain. Here, we performed a longitudinal PET study using the tau-selective PET tracer [18F]THK-5117 in patients with AD and in healthy control subjects. Annual changes in [18F]THK-5117 binding were significantly elevated in the middle and inferior temporal gyri and in the fusiform gyrus of patients with AD. Compared to patients with mild AD, patients with moderate AD showed greater changes in the tau load that were more widely distributed across the cortical regions. Furthermore, a significant correlation was observed between the annual changes in cognitive decline and regional [18F]THK-5117 binding. These results suggest that the cognitive decline observed in patients with AD is attributable to the progression of neurofibrillary pathology. Longitudinal assessment of tau pathology will contribute to the assessment of disease progression and treatment efficacy.