Interobserver agreement of current and new proposed endoscopic scores for postoperative recurrence in Crohn's disease

Michiel T J Bak; Nassim Hammoudi; Matthieu Allez; Mark S Silverberg; Isa M Schellekens; Nicole S Erler; Gerard Dijkstra; Mariëlle Romberg-Camps; Nanne K H de Boer; Sita V Jansen; Sander van der Marel; Carmen S Horjus; Marijn C Visschedijk; Rogier L Goetgebuer; Willemijn A van Dop; Jildou Hoekstra; Alexander G L Bodelier; Ilse Molendijk; Lauranne A A P Derikx; Fiona D M van Schaik; Rachel L West; Marjolijn Duijvestein; C Janneke van der Woude; Oddeke van Ruler; Annemarie C de Vries; Dutch Initiative on Crohn and Colitis and the RAP-CD study group

doi:10.1016/j.gie.2024.03.011

Interobserver agreement of current and new proposed endoscopic scores for postoperative recurrence in Crohn's disease

Gastrointest Endosc. 2024 Oct;100(4):703-709.e4. doi: 10.1016/j.gie.2024.03.011. Epub 2024 Mar 8.

Authors

Michiel T J Bak¹, Nassim Hammoudi², Matthieu Allez², Mark S Silverberg³, Isa M Schellekens¹, Nicole S Erler⁴, Gerard Dijkstra⁵, Mariëlle Romberg-Camps⁶, Nanne K H de Boer⁷, Sita V Jansen⁸, Sander van der Marel⁹, Carmen S Horjus¹⁰, Marijn C Visschedijk⁵, Rogier L Goetgebuer¹¹, Willemijn A van Dop¹², Jildou Hoekstra¹³, Alexander G L Bodelier¹³, Ilse Molendijk¹, Lauranne A A P Derikx¹, Fiona D M van Schaik¹⁴, Rachel L West¹⁵, Marjolijn Duijvestein¹², C Janneke van der Woude¹, Oddeke van Ruler¹⁶, Annemarie C de Vries¹⁷; Dutch Initiative on Crohn and Colitis and the RAP-CD study group

Affiliations

¹ Department of Gastroenterology and Hepatology (1), Erasmus University Medical Center Rotterdam, Rotterdam, the Netherlands.
² Gastroenterology Department, Hôpital Saint-Louis-APHP, Université Paris Cité, INSERM U1160, Paris, France.
³ Division of Gastroenterology, Department of Medicine, Mount Sinai Hospital, University of Toronto, Toronto, Ontario, Canada.
⁴ Department of Epidemiology, Erasmus MC University Medical Center, Rotterdam, the Netherlands; Department of Biostatistics, Erasmus MC University Medical Center, Rotterdam, the Netherlands.
⁵ Department of Gastroenterology and Hepatology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands.
⁶ Department of Gastroenterology, Geriatrics, Internal and Intensive Care Medicine (Co-MIK), Zuyderland Medical Centre, Heerlen-Sittard-Geleen, the Netherlands.
⁷ Department of Gastroenterology and Hepatology, AGEM Research Institute, Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
⁸ Department of Gastroenterology and Hepatology, Reinier de Graaf Groep, Delft, the Netherlands.
⁹ Department of Gastroenterology and Hepatology, Haaglanden Medical Center, The Hague, the Netherlands.
¹⁰ Department of Gastroenterology and Hepatology, Rijnstate Hospital, Arnhem, the Netherlands.
¹¹ Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, the Netherlands.
¹² Department of Gastroenterology and Hepatology, Radboud University Medical Center, Nijmegen, the Netherlands.
¹³ Department of Gastroenterology and Hepatology, Amphia Hospital, Breda, the Netherlands.
¹⁴ Department of Gastroenterology and Hepatology, University Medical Center Utrecht, Utrecht, the Netherlands.
¹⁵ Department of Gastroenterology and Hepatology, Franciscus Gasthuis & Vlietland, Rotterdam, the Netherlands.
¹⁶ Department of Surgery, IJsselland Hospital, Capelle aan den IJssel, the Netherlands; Department of Surgery, Erasmus University Medical Center Rotterdam, Rotterdam, the Netherlands.
¹⁷ Department of Gastroenterology and Hepatology (1), Erasmus University Medical Center Rotterdam, Rotterdam, the Netherlands. Electronic address: [email protected].

PMID: 38462057
DOI: 10.1016/j.gie.2024.03.011

Abstract

Background and aims: The modified Rutgeerts score (mRS) is widely used for the assessment of endoscopic postoperative recurrence (ePOR) in Crohn's disease (CD) after ileocolic resection to guide therapeutic decisions. To improve the validity and prognostic value of this endoscopic assessment, 2 new scores have been proposed. This study assessed the interobserver agreement of the current score (mRS) and the new endoscopic score for ePOR in CD.

Methods: Sixteen Dutch academic and nonacademic inflammatory bowel disease specialists assessed endoscopic videos (n = 71) of postoperative CD patients (n = 66) retrieved from 9 Dutch centers. Each video was assessed for degree of inflammation by 4 gastroenterologists using the mRS and the new proposed endoscopic score: the REMIND score (separate score of anastomosis and neoterminal ileum) and the updated Rutgeerts score (assessment of lesions at the anastomotic line, ileal inlet, ileal body, and neoterminal ileum). In addition, lesions at the ileal body, ileal inlet, neoterminal ileum, and colonic and/or ileal blind loop were separately assessed. Interobserver agreement was assessed by using Fleiss' weighted kappa.

Results: Fleiss' weighted kappa for the mRS was .67 (95% confidence interval [CI], .59-.74). The weighted kappa for the REMIND score was .73 (95% CI, .65-.80) for lesions in the neoterminal ileum and .46 (95% CI, .35-.58) for anastomotic lesions. The weighted kappa for the updated Rutgeerts score was .69 (95% CI, .62-.77). The weighted kappa for lesions in the ileal body, ileal inlet, neoterminal ileum, and colonic and ileal blind loop was .61 (95% CI, .49-.73), .63 (95% CI, .54-.72), .61 (95% CI, .49-.74), .83 (95% CI, .62-1.00) and .68 (95% CI, .46-.89), respectively.

Conclusions: The interobserver agreement of the mRS is substantial. Similarly, the interobserver agreement is substantial for the updated Rutgeerts score. According to the REMIND score, the interobserver agreement was substantial for lesions in the neoterminal ileum, although only moderate for anastomotic lesions. Because therapeutic decisions in clinical practice are based on these assessments, and these scores are used as outcome measure in clinical studies, further improvement of the interobserver agreement is essential.

MeSH terms

Adult
Anastomosis, Surgical*
Colon / pathology
Colon / surgery
Colonoscopy / methods
Crohn Disease* / pathology
Crohn Disease* / surgery
Female
Humans
Ileum* / pathology
Ileum* / surgery
Male
Middle Aged
Observer Variation*
Recurrence*
Severity of Illness Index
Young Adult