Retinoblastoma (RB; encoded by RB1) is a tumor suppressor that is frequently disrupted in tumorigenesis and acts in multiple cell types to suppress cell cycle progression. The role of RB in tumor progression, however, is poorly defined. Here, we have identified a critical role for RB in protecting against tumor progression through regulation of targets distinct from cell cycle control. In analyses of human prostate cancer samples, RB loss was infrequently observed in primary disease and was predominantly associated with transition to the incurable, castration-resistant state. Further analyses revealed that loss of the RB1 locus may be a major mechanism of RB disruption and that loss of RB function was associated with poor clinical outcome. Modeling of RB dysfunction in vitro and in vivo revealed that RB controlled nuclear receptor networks critical for tumor progression and that it did so via E2F transcription factor 1-mediated regulation of androgen receptor (AR) expression and output. Through this pathway, RB depletion induced unchecked AR activity that underpinned therapeutic bypass and tumor progression. In agreement with these findings, disruption of the RB/E2F/nuclear receptor axis was frequently observed in the transition to therapy resistance in human disease. Together, these data reveal what we believe to be a new paradigm for RB function in controlling prostate tumor progression and lethal tumor phenotypes.