Comparison of receiver operating curves derived from the same population: a bootstrapping approach

Comput Biomed Res. 1985 Apr;18(2):125-31. doi: 10.1016/0010-4809(85)90039-4.

Abstract

The receiver operating curve (ROC) gives a representation of sensitivity and specificity of a prediction model when varying the cutpoint of a decision rule on a whole spectrum. Evaluation of two models established (or tested) in the same population of patients warrants a valid statistical comparison of their ROC curves. Hanley et al. recently provided a method for overall comparison of ROC curves (J. A. Hanley and B. J. McNeil, Radiology 148, 839-843, 1983). Often ROC curves cross, or differ in only a part of their courses. Bootstrapping of ROC curves is proposed as a graphical check for the statistical significance of differences confined to a part of the curve. An example comparing two models of prediction of coronary artery disease progression is given to illustrate this new approach.

Publication types

  • Comparative Study

MeSH terms

  • Coronary Angiography
  • Coronary Disease / diagnostic imaging
  • Humans
  • Information Systems*
  • Models, Theoretical*
  • Probability*