Validity testing of a three-dimensionally printed endoscopic sinonasal surgery simulator

Objectives/hypothesis: To assess the face, content, construct, and concurrent validity of the PHACON Sinonasal Surgery Simulator (SNSS).

Study design: Prospective cohort study.

Methods: A total of 12 otolaryngology residents were recruited to perform sinonasal surgery on the simulator followed by cadaveric heads. Resident performances were recorded and de-identified. Face and content validities were evaluated based on 5-point Likert scale questionnaires. The recordings were evaluated by extramural expert rhinologists based on a validated Global Rating Scale (GRS). These results were analyzed and compared to assess construct and concurrent validity.

Results: The appearance of anatomic structures was rated as realistic by 75% of all participants, while only 30% and 41.7% rated the mucosal and bony tissues as realistic, respectively. A total of 91.7% of participants found the model useful for teaching anatomy, while 66.7% said it was useful for teaching operative technique. Construct validity was confirmed by showing significant differences in performance between the novice and experienced groups. Concurrent validity was confirmed by showing significant correlation between performance on the model and gold standard (i.e. cadaver head).

Conclusions: This study demonstrates the face, content, concurrent, and construct validity of a 3D-printed SNSS. Although this model has the potential to be a valuable tool in endoscopic sinus surgery training for otolaryngology residents, improvements are required with respect to the quality of simulated mucosal tissue as well as the simulated anatomy of the fronto-ethmoid compartment Level of Evidence: NA Laryngoscope, 2019.