Validating smoking data from the Veteran's Affairs Health Factors dataset, an electronic data source

Nicotine Tob Res. 2011 Dec;13(12):1233-9. doi: 10.1093/ntr/ntr206. Epub 2011 Sep 12.

Abstract

Introduction: We assessed smoking data from the Veterans Health Administration (VHA) electronic medical record (EMR) Health Factors dataset.

Methods: To assess the validity of the EMR Health Factors smoking data, we first created an algorithm to convert text entries into a 3-category smoking variable (never, former, and current). We compared this EMR smoking variable to 2 different sources of patient self-reported smoking survey data: (a) 6,816 HIV-infected and -uninfected participants in the 8-site Veterans Aging Cohort Study (VACS-8) and (b) a subset of 13,689 participants from the national VACS Virtual Cohort (VACS-VC), who also completed the 1999 Large Health Study (LHS) survey. Sensitivity, specificity, and kappa statistics were used to evaluate agreement of EMR Health Factors smoking data with self-report smoking data.

Results: For the EMR Health Factors and VACS-8 comparison of current, former, and never smoking categories, the kappa statistic was .66. For EMR Health Factors and VACS-VC/LHS comparison of smoking, the kappa statistic was .61.

Conclusions: Based on kappa statistics, agreement between the EMR Health Factors and survey sources is substantial. Identification of current smokers nationally within the VHA can be used in future studies to track smoking status over time, to evaluate smoking interventions, and to adjust for smoking status in research. Our methodology may provide insights for other organizations seeking to use EMR data for accurate determination of smoking status.

Publication types

  • Comparative Study
  • Research Support, N.I.H., Extramural
  • Research Support, U.S. Gov't, Non-P.H.S.
  • Validation Study

MeSH terms

  • Adult
  • Algorithms
  • Cohort Studies
  • Data Collection / standards*
  • Electronic Health Records / statistics & numerical data*
  • Female
  • Health Surveys
  • Humans
  • Male
  • Middle Aged
  • Reproducibility of Results
  • Self Report
  • Smoking / epidemiology*
  • Vereinigte Staaten
  • United States Department of Veterans Affairs
  • Veterans / statistics & numerical data*
  • Veterans Health / statistics & numerical data*