Practice Effects, Test-Retest Reliability, and Minimal Detectable Change of the Ruff 2 and 7 Selective Attention Test in Patients with Schizophrenia

Int J Environ Res Public Health. 2021 Sep 7;18(18):9440. doi: 10.3390/ijerph18189440.

Abstract

Background: The Ruff 2 and 7 Selective Attention Test (RSAT) is designed to measure selective attention. It tests automatic detection speed (ADS), automatic detection errors (ADE), automatic detection accuracy (ADA), controlled search speed (CSS), controlled search errors (CSE), and controlled search accuracy (CSA). The purpose of this study was to examine the test-retest reliability, practice effect, and minimum detectable change (MDC) of the RSAT in patients with schizophrenia.

Methods: A total of 101 patients with schizophrenia completed the RSAT twice at a 4-week interval. The intra-class correlation coefficient (ICC), paired t test, and effect size were used to examine the test-retest reliability and practice effect. The standard error of measurement (SEM) and MDC were calculated.

Results: The difference scores between the two assessments were significant in all the indexes. The absolute effect sizes were 0.14 to 0.30. The ICCs of the RSAT ranged from 0.69 to 0.91. The MDC% in the indexes of ADS, ADA, and CSA of the RSAT were <30%.

Conclusions: The RSAT is reliable for assessing selective attention in patients with schizophrenia. The RSAT has good to excellent test-retest reliability, a trivial to small practice effect, and indexes of ADS, ADA, and CSA, representing acceptable random measurement error.

Keywords: assessment; practice effect; psychometric properties; schizophrenia; selective attention; test–retest reliability.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Animals
  • Attention
  • Humans
  • Perches*
  • Reproducibility of Results
  • Schizophrenia* / diagnosis