On the asymptotic standard error of a class of robust estimators of ability in dichotomous item response models

Br J Math Stat Psychol. 2014 Nov;67(3):430-50. doi: 10.1111/bmsp.12027. Epub 2013 Sep 10.

Abstract

In item response theory, the classical estimators of ability are highly sensitive to response disturbances and can return strongly biased estimates of the true underlying ability level. Robust methods were introduced to lessen the impact of such aberrant responses on the estimation process. The computation of asymptotic (i.e., large-sample) standard errors (ASE) for these robust estimators, however, has not yet been fully considered. This paper focuses on a broad class of robust ability estimators, defined by an appropriate selection of the weight function and the residual measure, for which the ASE is derived from the theory of estimating equations. The maximum likelihood (ML) and the robust estimators, together with their estimated ASEs, are then compared in a simulation study by generating random guessing disturbances. It is concluded that both the estimators and their ASE perform similarly in the absence of random guessing, while the robust estimator and its estimated ASE are less biased and outperform their ML counterparts in the presence of random guessing with large impact on the item response process.

Keywords: ability estimation; estimating equations; item response theory; robust estimation; standard error.

MeSH terms

  • Aptitude*
  • Humans
  • Likelihood Functions
  • Models, Psychological*
  • Models, Statistical*
  • Psychological Tests / statistics & numerical data*
  • Psychology, Experimental / statistics & numerical data*
  • Psychometrics / statistics & numerical data*
  • Regression Analysis
  • Reproducibility of Results
  • Statistics as Topic