A Canadian evaluation framework for quality improvement in childhood arthritis: key performance indicators of the process of care

Background: The evaluation of quality of care in juvenile idiopathic arthritis (JIA) is critical for advancing patient outcomes but is not currently part of routine care across all centers in Canada. The study objective is to review the current landscape of JIA quality measures and use expert panel consensus to define key performance indicators (KPIs) that are important and feasible to collect for routine monitoring in JIA care in Canada.

Methods: Thirty-seven candidate KPIs identified from a systematic review were reviewed for inclusion by a working group including 3 pediatric rheumatologists. A shortlist of 14 KPIs was then assessed using a 3-round modified Delphi panel based on the RAND/UCLA Appropriateness Method. Ten panelists across Canada participated based on their expertise in JIA, quality measurement, or lived experience as a parent of a child with JIA. During rounds 1 and 3, panelists rated each KPI on a 1-9 Likert scale on themes of importance, feasibility, and priority. In round 2, panelists participated in a moderated in-person discussion that resulted in minor modifications to some KPIs. KPIs with median scores of ≥ 7 on all 3 questions without disagreement were included in the framework.

Results: Ten KPIs met the criteria for inclusion after round 3. Five KPIs addressed patient assessments: pain, joint count, functional status, global assessment of disease activity, and the clinical Juvenile Arthritis Disease Activity Score (cJADAS). Three KPIs examined access to care: wait times for consultation, access to pediatric rheumatologists within 1 year of diagnosis, and frequency of clinical follow-up. Safety was addressed through KPIs on tuberculous screening and laboratory monitoring. KPIs examining functional status using the Childhood Health Assessment Questionnaire (CHAQ), quality of life, uveitis, and patient satisfaction were excluded due to concerns about feasibility of measurement.

Conclusions: The proposed KPIs build upon existing KPIs and address important processes of care that should be measured to improve the quality of JIA care. The feasibility of capturing these measures will be tested in various data sources including the Understanding Childhood Arthritis Network (UCAN) studies. Subsequent work should focus on development of meaningful outcome KPIs to drive JIA quality improvement in Canada and beyond.