Improvements in Physician Clinical Workflow Measures After Implementation of a Dashboard Program

Purpose: To determine whether a combination of data-driven, personalized feedback and implementation of a graduated, sequential intervention model improved key measures of physician workflow and quality in radiation treatment planning.

Methods and materials: All radiation oncologists across 3 facilities at a single academic institution were prospectively evaluated on 5 predefined metrics of timeliness and accuracy in the treatment-planning process using a web-based institutional data repository and an institutional incident learning system. The study period encompassed 10 quarters from 2014 to 2016, with 2013 serving as a retrospective baseline. Physicians received quarterly individualized reports of their compliance metrics (a practice labeled the Physician Dashboard), and administrative interventions were initiated if >20% noncompliance with any metric was exceeded within a quarter. Consecutive quarters of noncompliance resulted in escalating interventions, including progress meetings with department leadership, and culminated in financial penalties. Rates of noncompliance were compared before and after implementation of this model.

Results: Three thousand six hundred sixty pre-Dashboard and 9497 post-Dashboard simulations were analyzed. After Dashboard implementation, significant reductions were observed in the rates of simulation orders requiring signature by a covering physician (14.1% vs 7.4%, P < .001), and the submission of plan contours ≥1 day (43.1% vs 23.1%, P < .001) or ≥2 days (30.8% vs 18.3%, P = .002) after the due date. There was some decrease in rates of inaccurate or incomplete plan submissions (6.2% vs 3.9%, P = .08). Seven of the 12 physicians received at least 1 intervention, with only 2 receiving all levels of intervention.

Conclusions: Regular assessment and targeted feedback using the Physician Dashboard significantly improved radiation oncologist compliance with clinically meaningful treatment planning responsibilities at a high-volume academic center.