Estimation of vaccination coverage from electronic healthcare records; methods performance evaluation - A contribution of the ADVANCE-project

PLoS One. 2019 Sep 18;14(9):e0222296. doi: 10.1371/journal.pone.0222296. eCollection 2019.

Abstract

Introduction: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines, using existing electronic healthcare record (eHR) databases in Europe. Part of the data in such sources is missing due to incomplete follow-up hampering the accurate estimation of vaccination coverage. We compared different methods for coverage estimation from eHR databases; naïve period prevalence, complete case period prevalence, period prevalence adjusted for follow-up time, Kaplan-Meier (KM) analysis and (adjusted) inverse probability weighing (IPW).

Methods: We created simulation scenarios with different proportions of completeness of follow-up. Both completeness independent and dependent from vaccination date and status were considered. The root mean squared error (RMSE) and relative difference between the estimated and true coverage were used to assess the performance of the different methods for each of the scenarios. We included data examples on the vaccination coverage of human papilloma virus and pertussis component containing vaccines from the Spanish BIFAP database.

Results: Under completeness independent from vaccination date or status, several methods provided estimates with bias close to zero. However, when dependence between completeness of follow-up and vaccination date or status was present, all methods generated biased estimates. The IPW/CDF methods were generally the least biased. Preference for a specific method should be based on the type of censoring and type of dependence between completeness of follow-up and vaccination. Additional insights into these aspects, might be gained by applying several methods.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Electronic Health Records / economics*
  • Europe
  • Humans
  • Papillomaviridae / immunology
  • Pertussis Vaccine / economics
  • Risk Assessment / economics
  • Vaccination / economics*
  • Vaccination Coverage / economics*

Substances

  • Pertussis Vaccine

Grants and funding

The research leading to these results has received support from the Innovative Medicines Initiative Joint Undertaking under ADVANCE grant agreement no. 115557, resources of which are composed of financial contribution from the European Union's Seventh Framework Programme (FP7/2007‐2013) and EFPIA companies' in kind contribution. Co-author V.B received a salary from GSK during the period in which this study was performed. The study sponsors had no role in study design, in the collection, analysis and interpretation of data, in the writing of the report, or in the decision to submit the report for publication. The specific roles of these authors are articulated in the ‘author contributions’ section.