Multicenter comparison using two AI stroke CT perfusion software packages for determining thrombectomy eligibility

J Stroke Cerebrovasc Dis. 2024 Jul;33(7):107750. doi: 10.1016/j.jstrokecerebrovasdis.2024.107750. Epub 2024 May 2.

Abstract

Background: Stroke AI platforms assess infarcted core and potentially salvageable tissue (penumbra) to identify patients suitable for mechanical thrombectomy. Few studies have compared outputs of these platforms, and none have been multicenter or considered NIHSS or scanner/protocol differences. Our objective was to compare volume estimates and thrombectomy eligibility from two widely used CT perfusion (CTP) packages, Viz.ai and RAPID.AI, in a large multicenter cohort.

Methods: We analyzed CTP data of acute stroke patients with large vessel occlusion (LVO) from four institutions. Core and penumbra volumes were estimated by each software and DEFUSE-3 thrombectomy eligibility assessed. Results between software packages were compared and categorized by NIHSS score, scanner manufacturer/model, and institution.

Results: Primary analysis of 362 cases found statistically significant differences in both software's volume estimations, with subgroup analysis showing these differences were driven by results from a single scanner model, the Canon Aquilion One. Viz.ai provided larger estimates with mean differences of 8cc and 18cc for core and penumbra, respectively (p<0.001). NIHSS subgroup analysis also showed systematically larger Viz.ai volumes (p<0.001). Despite volume differences, a significant difference in thrombectomy eligibility was not found. Additional subgroup analysis showed significant differences in penumbra volume for the Phillips Ingenuity scanner, and thrombectomy eligibility for the Canon Aquilion One scanner at one center (7 % increased eligibility with Viz.ai, p=0.03).

Conclusions: Despite systematic differences in core and penumbra volume estimates between Viz.ai and RAPID.AI, DEFUSE-3 eligibility was not statistically different in primary or NIHSS subgroup analysis. A DEFUSE-3 eligibility difference, however, was seen on one scanner at one institution, suggesting scanner model and local CTP protocols can influence performance and cause discrepancies in thrombectomy eligibility. We thus recommend centers discuss optimal scanning protocols with software vendors and scanner manufacturers to maximize CTP accuracy.

Keywords: Acute stroke; CT Perfusion; DEFUSE-3, Mechanical thrombectomy; Interventional neuroradiology; Ischemic stroke.

Publication types

  • Multicenter Study
  • Comparative Study

MeSH terms

  • Aged
  • Aged, 80 and over
  • Cerebrovascular Circulation*
  • Clinical Decision-Making
  • Computed Tomography Angiography
  • Female
  • Humans
  • Ischemic Stroke / diagnosis
  • Ischemic Stroke / diagnostic imaging
  • Ischemic Stroke / physiopathology
  • Ischemic Stroke / surgery
  • Ischemic Stroke / therapy
  • Male
  • Middle Aged
  • Patient Selection*
  • Perfusion Imaging* / methods
  • Predictive Value of Tests*
  • Radiographic Image Interpretation, Computer-Assisted*
  • Reproducibility of Results
  • Retrospective Studies
  • Software*
  • Stroke / diagnosis
  • Stroke / diagnostic imaging
  • Stroke / physiopathology
  • Stroke / surgery
  • Stroke / therapy
  • Thrombectomy* / adverse effects
  • Tomography, X-Ray Computed