Researchers have long sought to understand the genetic basis of the cognitive differences between primates, with particular focus on the human brain. Although all mutational types have worked in concert with evolutionary forces to generate the current human brain, in this review we will explore the impact of mobile elements, specifically non-LTR retrotransposons. Non-LTR retrotransposons have contributed coding and regulatory sequences to the genome throughout evolution. During primate evolution there have been multiple waves of LINE retrotransposition as well as the birth of new mobile elements such as the SINEs Alu and SVA and we will explore what kinds of impacts these may have had on the evolving human brain.