The psychometric properties of the "Reading the Mind in the Eyes" Test: an item response theory (IRT) analysis

Cogn Neuropsychiatry. 2017 May;22(3):233-253. doi: 10.1080/13546805.2017.1300091. Epub 2017 Mar 13.

Abstract

Introduction: The "Reading the Mind in the Eyes" Test (hereafter: Eyes Test) is considered an advanced task of the Theory of Mind aimed at assessing the performance of the participant in perspective-takingthat is, the ability to sense or understand other people's cognitive and emotional states. In this study, the item response theory analysis was applied to the adult version of the Eyes Test.

Methods: The Italian version of the Eyes Test was administered to 200 undergraduate students of both genders (males = 46%). Modified parallel analysis (MPA) was used to test unidimensionality. Marginal maximum likelihood estimation was used to fit the 1-, 2-, and 3-parameter logistic (PL) model to the data. Differential Item Functioning (DIF) due to gender was explored with five independent methods.

Results: MPA provided evidence in favour of unidimensionality. The Rasch model (1-PL) was superior to the other two models in explaining participants' responses to the Eyes Test. There was no robust evidence of gender-related DIF in the Eyes Test, although some differences may exist for some items as a reflection of real differences by group.

Conclusions: The study results support a one-factor model of the Eyes Test. Performance on the Eyes Test is defined by the participant's ability in perspective-taking. Researchers should cease using arbitrarily selected subscores in assessing the performance of participants to the Eyes Test. Lack of gender-related DIF favours the use of the Eyes Test in the investigation of gender differences concerning empathy and social cognition.

Keywords: Reading the mind in the eyes; differential item functioning; item response theory; social cognition; theory of mind.

Publication types

  • Validation Study

MeSH terms

  • Adult
  • Affective Symptoms / psychology*
  • Data Interpretation, Statistical
  • Empathy*
  • Eye*
  • Female
  • Gender Identity
  • Humans
  • Male
  • Models, Psychological*
  • Neuropsychological Tests
  • Psychometrics / standards*
  • Reproducibility of Results
  • Young Adult