Interpretable machine learning model predicting immune checkpoint inhibitor-induced hypothyroidism: A retrospective cohort study

Cancer Sci. 2024 Nov;115(11):3767-3775. doi: 10.1111/cas.16352. Epub 2024 Sep 23.

Abstract

Hypothyroidism is a known adverse event associated with the use of immune checkpoint inhibitors (ICIs) in cancer treatment. This study aimed to develop an interpretable machine learning (ML) model for individualized prediction of hypothyroidism in patients treated with ICIs. The retrospective cohort of patients treated with ICIs was from the First Affiliated Hospital of Ningbo University. ML methods applied include logistic regression (LR), random forest classifier (RFC), support vector machine (SVM), and extreme gradient boosting (XGBoost). The area under the receiver-operating characteristic curve (AUC) was the main evaluation metric used. Furthermore, the Shapley additive explanation (SHAP) was utilized to interpret the outcomes of the prediction model. A total of 458 patients were included in the study, with 59 patients (12.88%) observed to have developed hypothyroidism. Among the models utilized, XGBoost exhibited the highest predictive capability (AUC = 0.833). The Delong test and calibration curve indicated that XGBoost significantly outperformed the other models in prediction. The SHAP method revealed that thyroid-stimulating hormone (TSH) was the most influential predictor variable. The developed interpretable ML model holds potential for predicting the likelihood of hypothyroidism following ICI treatment in patients. ML technology offers new possibilities for predicting ICI-induced hypothyroidism, potentially providing more precise support for personalized treatment and risk management.

Keywords: Shapley additive explanation; adverse drug event; hypothyroidism; immune checkpoint inhibitors; machine learning.

MeSH terms

  • Adult
  • Aged
  • Female
  • Humans
  • Hypothyroidism* / chemically induced
  • Immune Checkpoint Inhibitors* / adverse effects
  • Logistic Models
  • Machine Learning*
  • Male
  • Middle Aged
  • Neoplasms / drug therapy
  • ROC Curve
  • Retrospective Studies
  • Support Vector Machine
  • Thyrotropin / blood

Substances

  • Immune Checkpoint Inhibitors
  • Thyrotropin