Editor's Choice - Development and Testing of Step, Error, and Event Frameworks to Evaluate Technical Performance in Peripheral Endovascular Interventions

Eur J Vasc Endovasc Surg. 2024 Aug;68(2):227-235. doi: 10.1016/j.ejvs.2024.03.007. Epub 2024 Mar 15.

Abstract

Objective: Tools for endovascular performance assessment are necessary in competency based education. This study aimed to develop and test a detailed analysis tool to assess steps, errors, and events in peripheral endovascular interventions (PVI).

Methods: A modified Delphi consensus was used to identify steps, errors, and events in iliac-femoral-popliteal endovascular interventions. International experts in vascular surgery, interventional radiology, cardiology, and angiology were identified, based on their scientific track record. In an initial open ended survey round, experts volunteered a comprehensive list of steps, errors, and events. The items were then rated on a five point Likert scale until consensus was reached with a pre-defined threshold (Cronbach's alpha > 0.7) and > 70% expert agreement. An experienced endovascular surgeon applied the finalised frameworks on 10 previously videorecorded elective PVI cases.

Results: The expert consensus panel was formed by 28 of 98 invited proceduralists, consisting of three angiologists, seven interventional radiologists, five cardiologists, and 13 vascular surgeons, with 29% from North America and 71% from Europe. The Delphi process was completed after three rounds (Cronbach's alpha; αsteps = 0.79; αerrors = 0.90; αevents = 0.90), with 15, 26, and 18 items included in the final step (73 - 100% agreement), error (73 - 100% agreement), and event (73 - 100% agreement) frameworks, respectively. The median rating time per case was 4.3 hours (interquartile range [IQR] 3.2, 5 hours). A median of 55 steps (IQR 40, 67), 27 errors (IQR 21, 49), and two events (IQR 1, 6) were identified per case.

Conclusion: An evaluation tool for the procedural steps, errors, and events in iliac-femoral-popliteal endovascular procedures was developed through a modified Delphi consensus and applied to recorded intra-operative data to identify hazardous steps, common errors, and events. Procedural mastery may be promoted by using the frameworks to provide endovascular proceduralists with detailed technical performance feedback.

Keywords: Angioplasty balloon; Delphi technique; Endovascular procedures; Medical errors.

MeSH terms

  • Clinical Competence*
  • Consensus
  • Delphi Technique*
  • Endovascular Procedures* / adverse effects
  • Endovascular Procedures* / education
  • Endovascular Procedures* / standards
  • Femoral Artery / surgery
  • Humans
  • Iliac Artery / surgery
  • Medical Errors / prevention & control
  • Peripheral Arterial Disease / diagnosis
  • Peripheral Arterial Disease / surgery
  • Peripheral Arterial Disease / therapy
  • Popliteal Artery / diagnostic imaging
  • Popliteal Artery / surgery