External validation of a modified cardiovascular sequential organ failure assessment score in patients with suspected infection using the MIMIC-IV database

PLoS One. 2024 Nov 12;19(11):e0312185. doi: 10.1371/journal.pone.0312185. eCollection 2024.

Abstract

We developed a modified cardiovascular (CV) Sequential Organ Failure Assessment (SOFA) score using an emergency department-based cohort data, incorporating norepinephrine equivalent dose and lactate to represent current clinical practice patterns for vasopressor utilization and the diagnostic significance of lactate, respectively. In this study, we sought to validate this modified CV-SOFA score in intensive care unit patients with suspected infection using the Marketplace for Medical Information in Intensive Care (MIMIC)-IV database. This was a retrospective study that utilized data from the MIMIC-IV database. Modified CV/total SOFA score and original CV/total SOFA score were compared for predicting in-hospital mortality. Area under the receiver operating characteristic curve (AUROC) and the calibration curve were employed to evaluate discrimination and calibration, respectively. A total of 29,618 ICU patients with suspected infections was analyzed. The in-hospital mortality rate was 12.4% (n = 3,675). Modified CV-SOFA score (AUROC 0.667; 95% confidence interval [CI] 0.657-0.677 vs. 0.663; 95% CI 0.654-0.673; p = 0.283) and modified total SOFA score (0.784 [95% CI 0.776-0.793] vs. 0.785 [95% CI 0.777-0.793], p = 0.490) did not differ significantly from the original CV-SOFA score and original total SOFA score, respectively. The calibration curve of the original CV-SOFA score was inferior to that of the modified CV-SOFA score. The modified CV- and total SOFA scores were better calibrated than the original CV- and total SOFA scores, but their discriminative performance was not significantly different. Further studies of the modified CV-SOFA score in different settings and populations are required to assess the generalizability of this score.

Publication types

  • Validation Study

MeSH terms

  • Aged
  • Databases, Factual*
  • Female
  • Hospital Mortality*
  • Humans
  • Infections / diagnosis
  • Infections / mortality
  • Intensive Care Units*
  • Lactic Acid / blood
  • Male
  • Middle Aged
  • Organ Dysfunction Scores*
  • ROC Curve
  • Retrospective Studies

Substances

  • Lactic Acid

Grants and funding

The National Basic Science Research Program provided funding through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (RS-2023-00251786) to Tae Gun Shin. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.