Addressing the implementation challenge of risk prediction model due to missing risk factors: The submodel approximation approach

Stat Med. 2024 Nov 20;43(26):4984-4999. doi: 10.1002/sim.10184. Epub 2024 Sep 12.

Abstract

Clinical prediction models have been widely acknowledged as informative tools providing evidence-based support for clinical decision making. However, prediction models are often underused in clinical practice due to many reasons including missing information upon real-time risk calculation in electronic health records (EHR) system. Existing literature to address this challenge focuses on statistical comparison of various approaches while overlooking the feasibility of their implementation in EHR. In this article, we propose a novel and feasible submodel approach to address this challenge for prediction models developed using the model approximation (also termed "preconditioning") method. The proposed submodel coefficients are equivalent to the corresponding original prediction model coefficients plus a correction factor. Comprehensive simulations were conducted to assess the performance of the proposed method and compared with the existing "one-step-sweep" approach as well as the imputation approach. In general, the simulation results show the preconditioning-based submodel approach is robust to various heterogeneity scenarios and is comparable to the imputation-based approach, while the "one-step-sweep" approach is less robust under certain heterogeneity scenarios. The proposed method was applied to facilitate real-time implementation of a prediction model to identify emergency department patients with acute heart failure who can be safely discharged home.

Keywords: clinical prediction model; electronic health records; implementation; missing risk factors.

MeSH terms

  • Computer Simulation*
  • Electronic Health Records*
  • Humans
  • Models, Statistical*
  • Risk Assessment / methods
  • Risk Factors