Assessment of individual operator performance using a risk-adjustment model for percutaneous coronary interventions

Mayo Clin Proc. 2013 Nov;88(11):1250-8. doi: 10.1016/j.mayocp.2013.07.017.

Abstract

Objective: To investigate the applicability of the Mayo Clinic Risk Score (MCRS) in the assessment of performance metrics of individual interventional cardiologists at 3 Mayo Clinic sites.

Participants and methods: We evaluated the risk-adjusted performance of 21 interventional cardiologists who performed 8187 percutaneous coronary intervention procedures at 3 Mayo Clinic sites from January 1, 2007, through December 31, 2010. Observed mortality, major adverse cardiac events (MACEs) (eg, death, Q-wave myocardial infarction, urgent or emergent coronary artery bypass graft, and stroke), and expected risk were estimated using the MCRS. To compare individual performance against the other operators, risk estimates were recalibrated by excluding the individual performer from logistic regression models.

Results: The log odds ratio for observed vs estimated risk was estimated for each interventional cardiologist, and their individual effects were then plotted on a normal probability plot to identify outliers. Observed in-hospital mortality was not different than expected (1.8% vs 1.6%; P=.24); however, the postprocedural MACE rate was lower than predicted (observed, 2.7%; expected, 3.8%; P<.001). All but one interventional cardiologist had MACE and death rates within the expected variation. Detailed assessment of that operator's risk performance produced excellent outcomes (observed vs expected MACE rate, 1.0% vs 4.4%).

Conclusion: The MCRS can serve as a tool for the assessment of performance metrics for interventional cardiologists, and risk-adjusted outcomes may serve as a better surrogate for institutional quality metrics.

Keywords: CABG; MACE; MCRS; MI; Mayo Clinic Risk Score; OR; PCI; coronary artery bypass graft; major adverse cardiovascular event; myocardial infarction; odds ratio; percutaneous coronary intervention.

MeSH terms

  • Aged
  • Clinical Competence / statistics & numerical data*
  • Female
  • Hospital Mortality
  • Humans
  • Logistic Models
  • Male
  • Percutaneous Coronary Intervention / adverse effects
  • Percutaneous Coronary Intervention / methods*
  • Percutaneous Coronary Intervention / mortality
  • Postoperative Complications / epidemiology
  • Postoperative Complications / etiology*
  • Risk Adjustment / methods*
  • Risk Factors
  • Treatment Outcome