Post hoc power is not informative

Genet Epidemiol. 2022 Oct;46(7):390-394. doi: 10.1002/gepi.22464. Epub 2022 Jun 1.

Abstract

Post hoc power estimates are often requested by reviewers and/or performed by researchers after a study has been conducted. The purpose of this commentary is to provide a heuristic explanation of why post hoc power should not be used. To illustrate our point, we provide a detailed simulation study of two essentially identical research experiments hypothetically conducted in parallel at two separate universities. The simulation demonstrates that post hoc power calculations are misleading and simply not informative for data interpretation. As such, we encourage authors and peer-reviewers to avoid using or requesting post hoc power calculations.

Keywords: achieved power; exploratory data analysis; observed power; postexperiment power; retrospective power.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Computer Simulation
  • Humans
  • Models, Genetic*