Interobserver Reliability of Spinal Adverse Events Severity System - Neuro (SAVES-N): A Prospective Adverse Event Reporting System for Neurosurgical Cases

Background: The reporting of adverse events (AEs) in neurosurgery uses inconsistent definitions and subjective grading systems. A standardized system for recording and describing AEs would allow valid comparisons to be drawn between different institutions, using different technologies, at different times. The Spinal Adverse Events Severity System - Neuro (SAVES-N) system is a modification of the well-validated SAVES-V2 system that encompasses complications from both cranial and spinal surgery. The objective of this study was to assess the interobserver reliability of SAVES-N in spinal and cranial neurosurgery.

Methods: Ten vignettes, including cranial and spinal neurosurgical cases, were assessed by groups of consultant neurosurgeons (n = 5) and neurosurgical registrars (n = 5) using the SAVES-N system. Interobserver reliability for the presence of AEs, the type of AE, and the SAVES severity grade of the AE were calculated using Gwet's AC2 and Fleiss' kappa and were interpreted using the thresholds described by Landis and Koch.

Results: Neurosurgeons had almost-perfect agreement (Gwet AC2 = 0.93), whereas registrars had substantial agreement (Gwet's AC2 = 0.74) in determining the presence or absence of AEs. Both neurosurgeons (Fleiss' kappa = 0.78) and registrars (Fleiss' kappa = 0.70) demonstrated substantial agreement within their groups as to the type of AE. Similarly, neurosurgeons (Gwet's AC2 = 0.94) and registrars (Gwet's AC2 = 0.81) both graded the severity of the AE with almost perfect agreement.

Conclusions: The results of this study demonstrate that the scope of the well-validated SAVES-V2 system may be broadened to cranial neurosurgical cases by SAVES-N with substantial to almost-perfect interobserver reliability.