Background: Machine learning (ML) techniques are widely employed across various domains to achieve accurate predictions. This study assessed the effectiveness of ML in predicting early mortality risk among patients with acute intracerebral hemorrhage (ICH) in real-world settings.
Methods and results: ML-based models were developed to predict in-hospital mortality in 527 patients with ICH using raw brain imaging data from brain computed tomography and clinical data. The models' performances were evaluated using the area under the receiver operating characteristic curves and calibration plots, comparing them with traditional risk scores such as the ICH score and ICH grading scale. Kaplan-Meier curves were used to examine the post-ICH survival rates, stratified by ML-based risk assessment. The net benefit of ML-based models was evaluated using decision curve analysis. The area under the receiver operating characteristic curves were 0.91 (95% CI, 0.86-0.95) for the ICH score, 0.93 (95% CI, 0.89-0.97) for the ICH grading scale, 0.83 (95% CI, 0.71-0.91) for the ML-based model fitted with raw image data only, and 0.87 (95% CI, 0.76-0.93) for the ML-based model fitted using clinical data without specialist expertise. The area under the receiver operating characteristic curve increased significantly to 0.97 (95% CI, 0.94-0.99) when the ML model was fitted using clinical and image data assessed by specialists. All ML-based models demonstrated good calibration, and the survival rates showed significant differences between risk groups. Decision curve analysis indicated the highest net benefit when utilizing the findings assessed by specialists.
Conclusions: ML-based prediction models exhibit satisfactory performance in predicting post-ICH in-hospital mortality when utilizing raw imaging data or nonspecialist input. Nevertheless, incorporating specialist expertise notably improves performance.
Keywords: deep learning; intracerebral hemorrhage; machine learning; prognostic score.