Histone acetylation is a dynamic modification regulated by the opposing actions of histone acetyltransferases (HATs) and histone deacetylases (HDACs). Deacetylation of histone tails results in chromatin tightening and therefore HDACs are generally regarded as transcriptional repressors. Counterintuitively, simultaneous deletion of Hdac1 and Hdac2 in embryonic stem cells (ESC) reduced expression of pluripotent transcription factors, Oct4, Sox2 and Nanog (OSN). By shaping global histone acetylation patterns, HDACs indirectly regulate the activity of acetyl-lysine readers, such as the transcriptional activator, BRD4. We used inhibitors of HDACs and BRD4 (LBH589 and JQ1 respectively) in combination with precision nuclear run-on and sequencing (PRO-seq) to examine their roles in defining the ESC transcriptome. Both LBH589 and JQ1 caused a marked reduction in the pluripotent network. However, while JQ1 treatment induced widespread transcriptional pausing, HDAC inhibition caused a reduction in both paused and elongating polymerase, suggesting an overall reduction in polymerase recruitment. Using enhancer RNA (eRNA) expression to measure enhancer activity we found that LBH589-sensitive eRNAs were preferentially associated with super-enhancers and OSN binding sites. These findings suggest that HDAC activity is required to maintain pluripotency by regulating the OSN enhancer network via the recruitment of RNA polymerase II.