Polyglutamine expansion within the androgen receptor (AR) causes spinal and bulbar muscular atrophy (SBMA) and is associated with misfolded and aggregated species of the mutant AR. We showed previously that nuclear localization of the mutant AR was necessary but not sufficient for SBMA. Here we show that an interdomain interaction of the AR that is central to its function within the nucleus is required for AR aggregation and toxicity. Ligands that prevent the interaction between the amino-terminal FXXLF motif and carboxyl-terminal AF-2 domain (N/C interaction) prevented toxicity and AR aggregation in an SBMA cell model and rescued primary SBMA motor neurons from 5α-dihydrotestosterone-induced toxicity. Moreover, genetic mutation of the FXXLF motif prevented AR aggregation and 5α-dihydrotestosterone toxicity. Finally, selective androgen receptor modulators, which prevent the N/C interaction, ameliorated AR aggregation and toxicity while maintaining AR function, highlighting a novel therapeutic strategy to prevent the SBMA phenotype while retaining AR transcriptional function.