Integration of Hands-On Team Training into Existing Curriculum Improves Both Technical and Nontechnical Skills in Laparoscopic Cholecystectomy

J Surg Educ. 2017 Nov-Dec;74(6):915-920. doi: 10.1016/j.jsurg.2017.05.007. Epub 2017 May 26.

Abstract

Objective: Nontechnical skills are an essential component of surgical education and a major competency assessed by the ACGME milestones project. However, the optimal way to integrate nontechnical skills training into existing curricula and then objectively evaluate the outcome is still unknown. The aim of this study was to determine the effect laparoscopic team-based task training would have on the nontechnical skills needed for laparoscopic surgery.

Design: 9 PGY-1 residents underwent an established training curriculum for teaching the knowledge and technical skills involved in laparoscopic cholecystectomy. Initial training involved a didactic session, expert-led practice on a porcine model in a simulated operating room and laparoscopic skills practice on a virtual reality trainer. Residents then performed a laparoscopic cholecystectomy on the same porcine model as a preintervention test. Three to four months following this, residents were subjected to specific nontechnical skills training involving 2 simple team-based laparoscopic tasks. They then practiced a further 4 to 6 hours on the virtual reality trainer. A repeat postintervention laparoscopic cholecystectomy was then performed 3 to 4 months after nontechnical skills training. Both the preintervention and postintervention laparoscopic cholecystectomies were audiovisually recorded and then evaluated by 2 independent surgeons in a blinded fashion. Technical skills were assessed using objective structured assessment of technical skills (OSATS) and a technique specific rating scale (TRS) that we developed for laparoscopic cholecystectomy. Nontechnical skills were assessed using nontechnical skills for surgeons (NOTSS). Residents also completed a survey at the beginning and end of the training.

Setting: Tertiary care, university based teaching institution.

Participants: A total of 9 general surgery residents at the intern level.

Results: The mean OSATS score improved from 13.7 ± 1.24 to 26.7 ± 0.31 (p < 0.001), the mean TRS score improved from 6 ± 0.46 to 13.1 ± 0.36 (p < 0.001) and the mean NOTSS score improved from 21.7 ± 1.83 to 36.3 ± 0.87 (p < 0.001) following the training. There was a strong correlation between OSATS and NOTSS scores (Pearson's R = 0.98) and TRS and NOTSS (R = 0.94). The inter-rater agreement was 0.79 for NOTSS, 0.9 for OSATS, and 0.82 for TRS. Following completion of the training, residents self-reported improvements in exchanging information (p < 0.01), coordinating activities (p < 0.01) and coping with pressure in the operating room (p < 0.001).

Conclusion: Simple, team-based nontechnical skills training for laparoscopic cholecystectomy that was separate from technical skills training led to a sustained increase in residents' nontechnical skills 3 to 4 months after training. This was associated with a self-reported improvement in many nontechnical skills based on resident survey. Based on these results, we recommend that such designated nontechnical skills training is a valid alternative to other methods such as coaching and debriefing. We, therefore, plan to continue our efforts to develop team-based simulation tasks aimed at improving nontechnical skills for multiple surgical modalities.

Keywords: Cholecystectomy; Interpersonal and Communication Skills; Laparoscopy; NOTSS; Nontechnical skills; OSATS.

Publication types

  • Comparative Study

MeSH terms

  • Animals
  • Cholecystectomy, Laparoscopic / education*
  • Cholecystectomy, Laparoscopic / methods
  • Clinical Competence*
  • Curriculum
  • Education, Medical, Graduate / organization & administration
  • Educational Measurement
  • Hospitals, University
  • Humans
  • Internship and Residency / organization & administration
  • Motor Skills / physiology*
  • Philadelphia
  • Simulation Training / methods*
  • Suture Techniques / education
  • Swine
  • Task Performance and Analysis