Early identification of younger, non-demented adults at elevated risk for Alzheimer's disease (AD) is crucial because the pathological process begins decades before dementia onset. Toward that end, we showed that an AD polygenic risk score (PRS) could identify mild cognitive impairment (MCI) in adults who were only in their 50s. Participants were 1176 white, non-Hispanic community-dwelling men of European ancestry in the Vietnam Era Twin Study of Aging (VETSA): 7% with amnestic MCI (aMCI); 4% with non-amnestic MCI (naMCI). Mean age was 56 years, with 89% <60 years old. Diagnosis was based on the Jak-Bondi actuarial/neuropsychological approach. We tested six P-value thresholds (0.05-0.50) for single nucleotide polymorphisms included in the ADPRS. After controlling for non-independence of twins and non-MCI factors that can affect cognition, higher PRSs were associated with significantly greater odds of having aMCI than being cognitively normal (odds ratios (ORs) = 1.36-1.43 for thresholds P < 0.20-0.50). The highest OR for the upper vs. lower quartile of the ADPRS distribution was 3.22. ORs remained significant after accounting for APOE-related SNPs from the ADPRS or directly genotyped APOE. Diabetes was associated with significantly increased odds of having naMCI (ORs = 3.10-3.41 for thresholds P < 0.05-0.50), consistent with naMCI having more vascular/inflammation components than aMCI. Analysis of sensitivity, specificity, and negative and positive predictive values supported some potential of ADPRSs for selecting participants in clinical trials aimed at early intervention. With participants 15+ years younger than most MCI samples, these findings are promising with regard to efforts to more effectively treat or slow AD progression.