The Hsp90 family proteins Hsp90, Grp94, and TRAP1 are present in the cell cytoplasm, endoplasmic reticulum, and mitochondria, respectively; all play important roles in tumorigenesis by regulating protein homeostasis in response to stress. Thus, simultaneous inhibition of all Hsp90 paralogs is a reasonable strategy for cancer therapy. However, since the existing pan-Hsp90 inhibitor does not accumulate in mitochondria, the potential anticancer activity of pan-Hsp90 inhibition has not yet been fully examined in vivo. Analysis of The Cancer Genome Atlas database revealed that all Hsp90 paralogs were upregulated in prostate cancer. Inactivation of all Hsp90 paralogs induced mitochondrial dysfunction, increased cytosolic calcium, and activated calcineurin. Active calcineurin blocked prosurvival heat shock responses upon Hsp90 inhibition by preventing nuclear translocation of HSF1. The purine scaffold derivative DN401 inhibited all Hsp90 paralogs simultaneously and showed stronger anticancer activity than other Hsp90 inhibitors. Pan-Hsp90 inhibition increased cytotoxicity and suppressed mechanisms that protect cancer cells, suggesting that it is a feasible strategy for the development of potent anticancer drugs. The mitochondria-permeable drug DN401 is a newly identified in vivo pan-Hsp90 inhibitor with potent anticancer activity.