External validity of a mortality prediction model in patients after open abdominal aortic aneurysm repair using multi-level methodology

Eur J Vasc Endovasc Surg. 2007 Nov;34(5):514-21. doi: 10.1016/j.ejvs.2007.06.017. Epub 2007 Aug 2.

Abstract

Objectives: Evaluation of the prognostic ability of the APACHE-AAA model in an independent group of post-operative (open) Abdominal Aortic Aneurysm (AAA) patients.

Methods: The model was applied to predict in-hospital mortality in 541 patients (325 elective and 216 emergencies; 489 from Oxford; 52 from Lewisham). Multi-level modelling was used to adjust for both the local structure and process of care and patient case-mix. Model performance was assessed using goodness-of-fit and subgroup analyses.

Results: The model's predictive ability to discriminate between dead and alive patients was very good (ROC area=0.84). The model achieved a good fit across all strata of risk (Hosmer-Lemeshow C-test (8, N=476)=7.777, p=0.456) and in all subgroups. The model was able to rank the ICUs according to their performance independently of the patient case-mix.

Conclusion: The APACHE-AAA model accurately predicted in-hospital mortality in a population of patients independent of the one used to develop it, confirming its validity. The multi-level methodology employed has shown that patient outcome is not only a function of the patient case-mix but instead predictive models should also adjust for the individual hospital-related factors (structure and process of care).

Publication types

  • Multicenter Study
  • Validation Study

MeSH terms

  • APACHE*
  • Aged
  • Aged, 80 and over
  • Aortic Aneurysm, Abdominal / mortality*
  • Aortic Aneurysm, Abdominal / surgery
  • Discriminant Analysis
  • England / epidemiology
  • Female
  • Hospital Mortality*
  • Humans
  • Logistic Models
  • Male
  • Models, Statistical
  • Outcome Assessment, Health Care
  • Prognosis
  • ROC Curve
  • Risk Assessment
  • Severity of Illness Index*