Exact calculations of average power for the Benjamini-Hochberg procedure

Int J Biostat. 2008;4(1):Article 11. doi: 10.2202/1557-4679.1103.

Abstract

Exact analytic expressions are developed for the average power of the Benjamini and Hochberg false discovery control procedure. The result is based on explicit computation of the joint probability distribution of the total number of rejections and the number of false rejections, and expressed in terms of the cumulative distribution functions of the p-values of the hypotheses. An example of analytic evaluation of the average power is given. The result is confirmed by numerical experiments and applied to a meta-analysis of three clinical studies in mammography.

Keywords: distribution of rejections; false discovery; hypothesis testing; meta-analysis; multiple comparisons.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Biostatistics / methods*
  • Breast Neoplasms / diagnostic imaging
  • False Positive Reactions
  • Female
  • Humans
  • Mammography / statistics & numerical data
  • Models, Statistical
  • Radiographic Image Enhancement