Variation in practice for discretionary admissions. Impact on estimates of quality of hospital care

JAMA. 1994 May 18;271(19):1493-8.

Abstract

Objective: To demonstrate theoretically and empirically the existence of systematic bias in commonly reported standardized hospital mortality ratios when variation in hospital admission practice is not adjusted for in the analysis. The underlying analytic model used in hospital mortality analyses is specified and the confounding effect of selection bias arising from variation in admission practice is shown.

Data sources: An empirical example is presented using state-level data from the Health Care Financing Administration's Medicare Hospital Information Report for 1988 to 1990.

Study selection: The Medicare Hospital Information data are used to demonstrate the effects of the bias because they contain population-based admission rates and mortality rates.

Data synthesis: Selection bias arising from variation in admission practice causes the expected mortality rate to be overestimated for all hospitals, but especially for hospitals with more lenient admission practices. Using the Medicare Hospital Information Report, the resulting standardized hospital mortality ratios are shown to be significantly inversely correlated with higher relative risks of hospitalization (P < .01).

Conclusion: Standardized hospital mortality ratios based on analyses that do not account for variation in admission practice among hospitals are biased. Variation in admission practice will cause any outcome measure based solely on hospitalized patients to be similarly biased. Correction for selection bias is required to produce valid measures of hospital quality.

MeSH terms

  • Bias
  • Centers for Medicare and Medicaid Services, U.S.
  • Fees, Medical
  • Health Maintenance Organizations / statistics & numerical data
  • Hospital Mortality*
  • Humans
  • Medicare
  • Models, Statistical
  • Outcome Assessment, Health Care / standards*
  • Outcome Assessment, Health Care / statistics & numerical data
  • Patient Admission / standards
  • Patient Admission / statistics & numerical data*
  • Practice Patterns, Physicians' / statistics & numerical data*
  • United States / epidemiology