The discovery of JAK2/MPL mutations in patients with myeloproliferative neoplasms (MPN) led to clinical development of Janus kinase (JAK) inhibitors for treatment of MPN. These inhibitors improve constitutional symptoms and splenomegaly but do not significantly reduce mutant allele burden in patients. We recently showed that chronic exposure to JAK inhibitors results in inhibitor persistence via JAK2 transactivation and persistent JAK-signal transducer and activator of transcription signaling. We performed genetic and pharmacologic studies to determine whether improved JAK2 inhibition would show increased efficacy in MPN models and primary samples. Jak2 deletion in vivo led to profound reduction in disease burden not seen with JAK inhibitors, and deletion of Jak2 following chronic ruxolitinib therapy markedly reduced mutant allele burden. This demonstrates that JAK2 remains an essential target in MPN cells that survive in the setting of chronic JAK inhibition. Combination therapy with the heat shock protein 90 (HSP90) inhibitor PU-H71 and ruxolitinib reduced total and phospho-JAK2 and achieved more potent inhibition of downstream signaling than ruxolitinib monotherapy. Combination treatment improved blood counts, spleen weights, and reduced bone marrow fibrosis compared with ruxolitinib alone. These data suggest alternate approaches that increase JAK2 targeting, including combination JAK/HSP90 inhibitor therapy, are warranted in the clinical setting.