Validation of the Objective Structured assessment of Technical Skill (OSATS) in China

Introduction: The aim of this study was to perform a cross-cultural adaptation of the Objective Structured assessment of Technical Skill (OSATS) tool into Chinese and to determine its reproducibility and validity in China.

Methods: A Chinese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing and then its validation. 59 candidates were included in the study in an international Chinese simulation center including medical students (5th year of medical studies), surgical fellow, attending surgeons, attending professors and professors of surgery. Two exercises performed on synthetic protheses (latex balloons) were designed and filmed: separate suture (3 points) and a circular anastomosis. Each candidate technical competencies were established according to the score by 3 experts. The results of the different scores were correlated against the theoretical background (TB) of the candidates (1 to 5), for each exercise.

Results: A Chinese version of OSATS was produced and validated through a back-translation process. The average professors' residents' and students' scores were 35 (± 0.2), 28 (± 0.4) and 18 (± 0.3) respectively. For the objective score cnOSATS on simple sutures, the mean increases from one TB level to the next was 1.63 (0.90-2.37), p < 0.001. For the objective score cnOSATS on running sutures, the mean increases from one TB level to the next was 1.99 (1.22 - 2.77), p < 0.001.

Conclusion: This study suggests that the Chinese version of OSATS can reliably and validly assess surgical skills in China.