Validation of a COVID-19 mental health and wellness survey questionnaire

Background and aim: COVID-19 affected mental health and wellbeing. Research is needed to assess its impact using validated tools. The study assessed the content validity, reliability and dimensionality of a multidimensional tool for assessing the mental health and wellbeing of adults.

Methods: An online questionnaire collected data in the second half of 2020 from adults in different countries. The questionnaire included nine sections assessing: COVID-19 experience and sociodemographic profile; health and memory; pandemic stress (pandemic stress index, PSI); financial and lifestyle impact; social support; post-traumatic stress disorder (PTSD); coping strategies; self-care and HIV profile over 57 questions. Content validity was assessed (content validity index, CVI) and participants evaluated the test-retest reliability (Kappa statistic and intra-class correlation coefficient, ICC). Internal consistency of scales was assessed (Cronbach α). The dimensionality of the PSI sections and self-care strategies was assessed by multiple correspondence analysis (MCA) using all responses and SPSS. For qualitative validation, we used a semi-structured interview and NVivo was used for coding and thematic analysis.

Results: The overall CVI = 0.83 with lower values for the memory items. Cronbach α for the memory items = 0.94 and ICC = 0.71. Cronbach α for PTSD items was 0.93 and ICC = 0.89. Test-retest scores varied by section. The 2-dimensions solution of MCA for the PSI behavior section explained 33.6% (precautionary measures dimension), 11.4% (response to impact dimension) and overall variance = 45%. The 2-dimensions of the PSI psychosocial impact explained 23.5% (psychosocial impact of the pandemic dimension), 8.3% (psychosocial impact of the precautionary measures of the pandemic dimension) and overall variance = 31.8%. The 2-dimensions of self-care explained 32.9% (dimension of self-care strategies by people who prefer to stay at home and avoid others), 9% (dimension of self-care strategies by outward-going people) and overall variance = 41.9%. Qualitative analysis showed that participants agreed that the multidimensional assessment assessed the effect of the pandemic and that it was better suited to the well-educated.

Conclusion: The questionnaire has good content validity and can be used to assess the impact of the pandemic in cross-sectional studies especially as individual items. The PSI and self-care strategies need revision to ensure the inclusion of items with strong discrimination.