A framework for best practices in clinical outcome assessment (COA) concept mapping: a case study

Qual Life Res. 2024 Nov;33(11):2941-2948. doi: 10.1007/s11136-024-03773-2. Epub 2024 Aug 29.

Abstract

Purpose: Mapping or matching the items in a clinical outcome assessment (COA) to concepts that define a condition is a common method for evaluating a COA's concept coverage. The purpose of this research was to address the lack of formal guidance for conducting this task by developing a framework for best practices in COA concept mapping and applying it to a case study.

Methods: To develop the framework, we examined the literature and created a draft set of best practices which was then reviewed by experienced researchers through focus groups before being finalized. To conduct the case study, we extracted data from a systematic review of knee osteoarthritis (KO) symptoms and impacts and used the framework to map relevant concepts to items in the SF-36v2® Health Survey (SF-36v2).

Results: The framework guides researchers in defining the purpose of and data sources for the mapping, establishing guiding principles and decision-making thresholds, and conducting the mapping exercise. The results of the case study demonstrate the usefulness of the framework in identifying 27/36 items (75%) in the SF-36v2 that addressed concepts that define KO.

Conclusion: This case study illustrates how the framework for best practices in COA concept mapping may be used, highlighting how establishing clear concept definitions and guiding principles and following a structured process throughout can help produce consistent, reliable, and reproducible results. The results from this rigorous approach can provide valuable evidence to support decisions about the appropriateness of a COA for the intended patient population.

Keywords: Clinical outcome assessment; Concept mapping; Patient-reported outcome; Qualitative.

Plain language summary

In health-related quality of life research, mapping items in a clinical outcome assessment (COA) to concepts that define a health condition is one way to evaluate an instrument’s content validity (or, how well the instrument addresses the concepts it intends to measure). Without formal guidance on how to do this mapping, researchers can be inconsistent. This article describes the development of a framework for best practices in COA concept mapping. Informed by the literature and input from researchers with expertise in COA development and evaluation, the final framework guides researchers through the mapping process from start to finish, from helping to define the purpose of the task and identify the data sources, to establishing guiding principles and decision-making thresholds, conducting the mapping, and displaying the results. A case study—in which items from the SF-36v2® Health Survey were mapped to concepts from a systematic review of knee osteoarthritis symptoms and impacts—shows the framework in action, demonstrating how following the best practices can lead to consistent results that can support the evaluation of an instrument’s content validity.

MeSH terms

  • Concept Formation
  • Focus Groups
  • Humans
  • Osteoarthritis, Knee / psychology
  • Outcome Assessment, Health Care*
  • Quality of Life
  • Surveys and Questionnaires