Assessing Validity and Bias of Within-Person Variability in Affect and Personality

Pers Soc Psychol Bull. 2023 Nov 22:1461672231208499. doi: 10.1177/01461672231208499. Online ahead of print.

Abstract

Within-person variability in affect (e.g., Neuroticism) and personality have been linked to well-being. These are measured either by asking people to report how variable they are or to give multiple reports on the construct and calculating a within-person standard deviation adjusted for confounding by the person-level mean. The two measures are weakly correlated with one another and the links of variability with well-being depend on which measure researchers use. Recent research suggests that people's repeated ratings may be biased by response styles. In a 7-day study (N = 399) with up to five measurements per day, we confirmed that the measures of variability lacked sufficient convergent validity to be used interchangeably. We found only 1 significant correlation (of 10) between variability in repeated ratings of affect or personality and variability in repeated ratings of a theoretically unrelated construct (i.e., features of images). There was very little evidence supporting the response styles hypothesis.

Keywords: emotions; measurement; neuroticism; personality; variability.