A Comparison of Test-Retest Reliability and Practice Effects of Short Portable Mental State Questionnaire and Montreal Cognitive Assessment in Patients with Stroke

J Geriatr Psychiatry Neurol. 2025 Jan;38(1):53-61. doi: 10.1177/08919887241266793. Epub 2024 Jul 24.

Abstract

Objective: To compare the test-retest reliabilities and minimal detectable change (MDC) of the Short Portable Mental State Questionnaire (SPMSQ) and the Montreal Cognitive Assessment (MoCA) in patients with stroke.

Methods: 63 patients were recruited from 1 medical center. The SPMSQ and MoCA were administered twice, 2 weeks apart.

Results: Both measures showed high intraclass correlation coefficients (SPMSQ: 0.87; MoCA: 0.89) and acceptable MDC%s (SPMSQ: 14.8%; MoCA: 19.6%). A small correlation (r = 0.30) was found between the absolute difference and average in each pair of assessments in the SPMSQ, which was close to the criterion of heteroscedasticity. A small practice effect was observed in the MoCA (Cohen's d = 0.30).

Conclusion: The SPMSQ demonstrated smaller random measurement error and an absence of practice effect. When comparing the psychometric properties of the SPMSQ and MoCA as outcome measures for assessing cognitive function in patients with stroke, the SPMSQ appears to be a more suitable choice than the MoCA.

Keywords: cognitive function; montreal cognitive assessment; practice effect; random measurement error; short portable mental state questionnaire; stroke; test-retest reliability.

Publication types

  • Comparative Study

MeSH terms

  • Aged
  • Aged, 80 and over
  • Cognitive Dysfunction / diagnosis
  • Cognitive Dysfunction / psychology
  • Female
  • Humans
  • Male
  • Mental Status and Dementia Tests* / standards
  • Mental Status and Dementia Tests* / statistics & numerical data
  • Middle Aged
  • Neuropsychological Tests / standards
  • Neuropsychological Tests / statistics & numerical data
  • Psychometrics* / instrumentation
  • Psychometrics* / standards
  • Reproducibility of Results
  • Stroke* / complications
  • Stroke* / psychology
  • Surveys and Questionnaires / standards