Risk Prediction of Diabetic Foot Amputation Using Machine Learning and Explainable Artificial Intelligence

J Diabetes Sci Technol. 2024 Jan 30:19322968241228606. doi: 10.1177/19322968241228606. Online ahead of print.

Abstract

Background: Diabetic foot ulcers (DFUs) are serious complications of diabetes which can lead to lower extremity amputations (LEAs). Risk prediction models can identify high-risk patients who can benefit from early intervention. Machine learning (ML) methods have shown promising utility in medical applications. Explainable modeling can help its integration and acceptance. This study aims to develop a risk prediction model using ML algorithms with explainability for LEA in DFU patients.

Methods: This study is a retrospective review of 2559 inpatient DFU episodes in a tertiary institution from 2012 to 2017. Fifty-one features including patient demographics, comorbidities, medication, wound characteristics, and laboratory results were reviewed. Outcome measures were the risk of major LEA, minor LEA and any LEA. Machine learning models were developed for each outcome, with model performance evaluated using receiver operating characteristic (ROC) curves, balanced-accuracy and F1-score. SHapley Additive exPlanations (SHAP) was applied to interpret the model for explainability.

Results: Model performance for prediction of major, minor, and any LEA event achieved ROC of 0.820, 0.637, and 0.756, respectively, with XGBoost, XGBoost, and Gradient Boosted Trees algorithms demonstrating best results for each model, respectively. Using SHAP, key features that contributed to the predictions were identified for explainability. Total white cell (TWC) count, comorbidity score and red blood cell count contributed highest weightage to major LEA event. Total white cell, eosinophils, and necrotic eschar in the wound contributed most to any LEA event.

Conclusions: Machine learning algorithms performed well in predicting the risk of LEA in a patient with DFU. Explainability can help provide clinical insights and identify at-risk patients for early intervention.

Keywords: SHapley Additive exPlanations; diabetes; diabetic foot ulcer; lower extremity amputation; machine learning; model explainability; wounds.