Precise regulation of Rag (recombination-activating gene) expression is crucial to prevent genomic instability caused by the generation of Rag-mediated DNA breaks. Although mechanisms of Rag activation have been well characterized, the mechanism by which Rag expression is down-regulated in early B cell development has not been fully elucidated. Using a complementary DNA library screen, we identified the transcriptional repressor Gfi1b as negative regulator of the Rag locus. Expression of Gfi1b causes repression of Rag1 and Rag2 in cell lines and primary mouse cells. Conversely, Gfi1b-deficient cell lines exhibit increased Rag expression, double-strand breaks and recombination, and cell cycle defects. In primary cells, transcription of Gfi1b inversely correlates with Rag transcription, and simultaneous inactivation of Gfi1 and Gfi1b leads to an increase in Rag transcription early in B cell development. In addition, deletion of Gfi1 and Gfi1b in vivo results in a severe block in B cell development. Gfi1b orchestrates Rag repression via a dual mechanism. Direct binding of Gfi1b to a site 5' of the B cell-specific Erag enhancer results in epigenetic changes in the Rag locus, whereas indirect inhibition is achieved through repression of the trans-activator Foxo1. Together, our experiments show that Gfi family members are essential for normal B cell development and play an important role in modulating expression of the V(D)J recombinase.