External validation of a prognostic model to improve prediction of psychosis: a retrospective cohort study in primary care

Br J Gen Pract. 2024 Nov 28;74(749):e854-e860. doi: 10.3399/BJGP.2024.0017. Print 2024 Dec.

Abstract

Background: Early detection could reduce the duration of untreated psychosis. GPs are a vital part of the psychosis care pathway, but find it difficult to detect the early features. An accurate risk prediction tool, P Risk, was developed to detect these.

Aim: To externally validate P Risk.

Design and setting: This retrospective cohort study used a validation dataset of 1 647 934 UK Clinical Practice Research Datalink (CPRD) primary care records linked to secondary care records.

Method: The same predictors (age; sex; ethnicity; social deprivation; consultations for suicidal behaviour, depression/anxiety, and substance misuse; history of consultations for suicidal behaviour; smoking history; substance misuse; prescribed medications for depression/anxiety/post-traumatic stress disorder/obsessive compulsive disorder; and total number of consultations) were used as for the development of P Risk. Predictive risk, sensitivity, specificity, and likelihood ratios were calculated for various risk thresholds. Discrimination (Harrell's C-index) and calibration were calculated. Results were compared between the development (CPRD GOLD) and validation (CPRD Aurum) datasets.

Results: Psychosis risk increased with values of the P Risk prognostic index. Incidence was highest in younger age groups and, in the main, higher in males. Harrell's C was 0.79 (95% confidence interval = 0.78 to 0.79) in the validation dataset and 0.77 in the development dataset. A risk threshold of 1.0% gave sensitivity of 65.9% and specificity of 86.6%.

Conclusion: Further testing is required, but P Risk has the potential to be used in primary care to detect future risk of psychosis.

Keywords: early medical intervention; early psychosis; electronic health records; external validation; prediction; primary health care.

Publication types

  • Validation Study

MeSH terms

  • Adolescent
  • Adult
  • Early Diagnosis
  • Female
  • Humans
  • Male
  • Middle Aged
  • Primary Health Care*
  • Prognosis
  • Psychotic Disorders* / diagnosis
  • Psychotic Disorders* / epidemiology
  • Retrospective Studies
  • Risk Assessment
  • Risk Factors
  • Sensitivity and Specificity
  • United Kingdom / epidemiology
  • Young Adult

Grants and funding

The National Institute for Health and Care Research School for Primary Care Research (Grant Ref No. 416), the Biomedical Research Centres at the University of Bristol (BRC-1215-20011), and University College London (NIHR203328)