Evaluation of the psychometric performance of the Spanish and Catalan versions of the patient reported experiences and Outcomes of Safety in Primary Care (PREOS-PC)-Compact questionnaire

Eur J Gen Pract. 2024 Dec;30(1):2296573. doi: 10.1080/13814788.2023.2296573. Epub 2024 Jan 10.

Abstract

Background: Patients provide a unique, irreplaceable, and essential perspective in evaluating patient safety. The suite of Patient Reported Experiences and Outcomes of Safety in Primary Care (PREOS-PC) tools are a notable exception to the scarcity of patient-reported patient safety measures. Full evaluation of their performance has only been attempted for the English version, thereby limiting its international applicability.

Objectives: To assess the psychometric performance of the Spanish and Catalan versions of the PREOS-PC-Compact.

Methods: Cross-sectional validation study. We used Classical Test Theory methods to examine scale score distribution, internal consistency, and construct validity; and Item Response Theory (IRT) methods to further explore construct validity.

Results: 3287 patients completed the Spanish version, and 1007 the Catalan version. Similar results were obtained for both versions. Confirmatory Factor Analysis supported a single construct for each scale. The correlations between PREOS-PC-Compact scales and known group analysis suggested adequate construct validity (inconclusive for known groups at the provider level). All four multi-item scales demonstrated adequate internal consistency reliability (α > 0.7), which was only confirmed for test-retest reliability for 'Practice activation.' A sample between 60-90 patients per practice was estimated sufficient to produce scores with reliability > 0.7 for all scales except for harm scales. IRT models showed disordered thresholds for 'Practice activation' and 'Harm burden' but showed excellent fit after reducing the response categories.

Conclusion: The Spanish and Catalan versions of the PREOS-PC-Compact are broadly valid and reliable tools to measure patient safety in Spanish primary care centres; confirmation of lower-than-expected test-rest reliability merits further examination .

Keywords: Health care evaluation mechanisms; observational study; patient reported outcomes; patient safety; primary health care.

MeSH terms

  • Cross-Sectional Studies
  • Humans
  • Patient Reported Outcome Measures*
  • Primary Health Care*
  • Psychometrics
  • Reproducibility of Results

Grants and funding

This study was supported by a personal award (Miguel Servet Fellowship CP17/00017) to IR-C awarded by the Instituto de Salud Carlos III (Spanish Ministry of Sciences and Innovation) and co-funded by Fondo Europeo de Desarrollo Regional (FEDER). MJS-R and MAF-dR were funded by Instituto de Investigación Sanitaria de las Islas Baleares, grant number FOLIUM17/10 (co-funded by ITS-2017 and PO FSE 2014-2020) and FOLIUM19/05 (founded by ITS-2019-003), respectively. The payment of the open access publication fees has been supported by the 2023 LIBERI programm from IdISBa. Any grant or award did not grant the rest of authors to develop this work.