Translational regulation plays an essential role in Drosophila ovarian germline stem cell (GSC) biology. GSC self-renewal requires two translational repressors, Nanos (Nos) and Pumilio (Pum), which repress the expression of differentiation factors in the stem cells. The molecular mechanisms underlying this translational repression remain unknown. Here, we show that the CCR4 deadenylase is required for GSC self-renewal and that Nos and Pum act through its recruitment onto specific mRNAs. We identify mei-P26 mRNA as a direct and major target of Nos/Pum/CCR4 translational repression in the GSCs. mei-P26 encodes a protein of the Trim-NHL tumor suppressor family that has conserved functions in stem cell lineages. We show that fine-tuning Mei-P26 expression by CCR4 plays a key role in GSC self-renewal. These results identify the molecular mechanism of Nos/Pum function in GSC self-renewal and reveal the role of CCR4-NOT-mediated deadenylation in regulating the balance between GSC self-renewal and differentiation.