Predictive Value of Machine Learning Models in Postoperative Mortality of Older Adults Patients with Hip Fracture: A Systematic Review and Meta-analysis

Background: Some researchers have used machine learning to predict mortality in old patients with hip fracture, but its application value lacks an evidence-based basis. Hence, we conducted this meta-analysis to explore the predictive accuracy of machine learning for mortality in old patients with hip fracture.

Methods: We systematically retrieved PubMed, Cochrane, Embase, and Web of Science for relevant studies published before July 15, 2022. The PROBAST assessment tool was used to assess the risk of bias in the included studies. A random-effects model was used for the meta-analysis of C-index, whereas a bivariate mixed-effects model was used for the meta-analysis of sensitivity and specificity. The meta-analysis was performed on R and Stata.

Results: Eighteen studies were included, involving 8 machine learning models and 398,422 old patients undergoing hip joint surgery, of whom 60,457 died. According to the meta-analysis, the pooled C-index for machine learning models was 0.762 (95% CI: 0.691 ∼ 0.833) in the training set and 0.838 (95% CI: 0.783 ∼ 0.892) in the validation set, which is better than the C-index of the main clinical scale (Nottingham Hip Fracture Score), that is, 0.702 (95% CI: 0.681 ∼ 0.723). Among different machine learning models, ANN and Bayesian belief network had the best predictive performance.

Conclusion: Machine learning models are more accurate in predicting mortality in old patients after hip joint surgery than current mainstream clinical scoring systems. Subsequent research could focus on updating clinical scoring systems and improving their predictive performance by relying on machine learning models.