Reassessing the evidence for universal school-age BCG vaccination in England and Wales: re-evaluating and updating a modelling study

Objectives: In 2005, England and Wales switched from universal BCG vaccination against tuberculosis (TB) disease for school-age children to targeted vaccination of neonates. We aimed to recreate and re-evaluate a previously published model, the results of which informed this policy change.

Design: We recreated an approach for estimating the impact of ending the BCG schools scheme, correcting a methodological flaw in the model, updating the model with parameter uncertainty and improving parameter estimates where possible. We investigated scenarios for the assumed annual decrease in TB incidence rates considered by the UK's Joint Committee on Vaccination and Immunisation and explored alternative scenarios using notification data.

Setting: England and Wales.

Outcome measures: The number of vaccines needed to prevent a single notification and the average annual additional notifications caused by ending the policy change.

Results: The previously published model was found to contain a methodological flaw and to be spuriously precise. It greatly underestimated the impact of ending school-age vaccination compared with our updated, corrected model. The updated model produced predictions with wide CIs when parameter uncertainty was included. Model estimates based on an assumption of an annual decrease in TB incidence rates of 1.9% were closest to those estimated using notification data. Using this assumption, we estimate that 1600 (2.5; 97.5% quantiles: 1300, 2000) vaccines would have been required to prevent a single notification in 2004.

Conclusions: The impact of ending the BCG schools scheme was found to be greater than previously thought when notification data were used. Our results highlight the importance of independent evaluations of modelling evidence, including uncertainty, and evaluating multiple scenarios when forecasting the impact of changes in vaccination policy.