Comparison of nontechnical skills grading rubrics for OR in situ simulation for general surgery and Obstetrician/Gynecologist residents

Background: This study utilized the Team Strategies and Tools to Enhance Performance and Patient Safety and the Nontechnical Skills for Surgeons grading systems to evaluate the nontechnical skills of general surgery and obstetrician/gynecologist residents to see if these grading systems were concordant. These simulations were also intended to teach about crisis resources available at our institution.

Methods: Nineteen teams were created consisting of either one general surgery resident or 2 Obstetrician/Gynecologist residents plus 2 Anesthesia residents and 2 to 4 nurses. Each team was given a short briefing on Team Strategies and Tools to Enhance Performance and Patient Safety, then performed 2 simulated operating room crises. All exercises were graded by 2 independent observers with experience in the operating room and in using the Team Strategies and Tools to Enhance Performance and Patient Safety and Nontechnical Skills for Surgeons grading systems.

Results: Averaged general surgery Team Strategies and Tools To Enhance Performance and Patient Safety score increased between scenarios (14.3-17; P ≤ .01), as did obstetrician/gynecologist Team Strategies and Tools to Enhance Performance and Patient Safety score (14.9-19.2; P ≤ .01). Averaged general surgery Nontechnical Skills for Surgeons score increased between scenarios (10.3-12.2; P ≤ .02), as did obstetrician/gynecologist Nontechnical Skills for Surgeons score (10.2-14.3; P ≤ .01). Surgery Team Strategies and Tools to Enhance Performance and Patient Safety scores demonstrated a strong correlation of movement with Nontechnical Skills for Surgeons scores (r = 0.83), as did obstetrician/gynecologist (r = 0.91). On average both general surgery (11%-100%; P ≤ .01) and obstetrician/gynecologist (50%-90%; P ≤ .01) saw a statistically significant increase in their awareness of the crisis checklist.

Conclusion: Team Strategies and Tools to Enhance and Patient Safety scores and Nontechnical Skills for Surgeons are effective and concordant tools for gauging general surgery and obstetrician/gynecologist resident nontechnical skills. In situ simulations are an effective way to teach general surgery and obstetrician/gynecologist residents about available crisis resources.