Intra- and inter-rater consistency of dual assessment by radiologist and neurologist for evaluating DWI-ASPECTS in ischemic stroke

Objectives: To estimate the intra -and inter-rater consistency of radiologist and neurologist working in pairs attributing DWI-ASPECTS (Diffusion Alberta Stroke Program Early CT Score) in patients with acute middle cerebral artery ischemic stroke referred for mechanical thrombectomy, intravenous thrombolysis or bridging therapy.

Methods: Five neurologists and 5 radiologists working in pairs and in hour period scored independently and in two reading sessions anonymized DWI-ASPECTS of 80 patients presenting with acute anterior ischaemic stroke in our center. We measured agreement between pairs using intraclass correlation coefficients (ICCs). A Fleiss kappa was used for dichotomized (0-6;7-10) and trichotomized (0-3;4-6;7-10) ASPECTS. The interrater distribution of the score in the trichotomized (0-3;4-6;7-10) ASPECTS was calculated. We determined the interrater (Cohen kappa) and intrarater (Fleiss kappa) agreement on the ASPECTS regions.

Results: The average DWI-ASPECTS was 6.35 (SD±2.44) for the first reading, and 6.47 (SD±2.44) for the second one. The ICC was 0.853 (95%CI, 0.798-0.896) for the interrater, and 0.862 (95%CI, 0.834-0.885) for the intrarater evaluation. Kappa coefficients were high for dichotomized (k=0.75) and trichotomized (k=0.64) ASPECTS. Evaluators agreement on the ASPECTS category (0-3), (4-6) and (7-10) was 88, 76 and 93% respectively. The anatomic region infarcted was well identified (k=0.70-0.77), except for the internal capsula (k=0.57). Interrater agreement was fair for M5 (k=0.37), moderate for internal capsula (0.52) and substantial for the other regions (0.60-0.79).

Conclusions: Reliability of DWI-ASPECTS is good when determined by radiologist and neurologist working in pairs, which corresponds to our current clinical practice. However, discrepancies are possible for cut-off determination, which may impact the indication of thrombectomy, and for the determination of the exact infarcted region. Agreement to propose category (4-6) is lower than for (0-3) and (8-10) ASPECTS categories.