Skip to main content
Top
Published in: BMC Public Health 1/2022

Open Access 01-12-2022 | Obesity | Research

Small-area estimation for public health surveillance using electronic health record data: reducing the impact of underrepresentation

Authors: Tom Chen, Wenjun Li, Bob Zambarano, Michael Klompas

Published in: BMC Public Health | Issue 1/2022

Login to get access

Abstract

Background

Electronic Health Record (EHR) data are increasingly being used to monitor population health on account of their timeliness, granularity, and large sample sizes. While EHR data are often sufficient to estimate disease prevalence and trends for large geographic areas, the same accuracy and precision may not carry over for smaller areas that are sparsely represented by non-random samples.

Methods

We developed small-area estimation models using a combination of EHR data drawn from MDPHnet, an EHR-based public health surveillance network in Massachusetts, the American Community Survey, and state hospitalization data. We estimated municipality-specific prevalence rates of asthma, diabetes, hypertension, obesity, and smoking in each of the 351 municipalities in Massachusetts in 2016. Models were compared against Behavioral Risk Factor Surveillance System (BRFSS) state and small area estimates for 2016.

Results

Integrating progressively more variables into prediction models generally reduced mean absolute error (MAE) relative to municipality-level BRFSS small area estimates: asthma (2.24% MAE crude, 1.02% MAE modeled), diabetes (3.13% MAE crude, 3.48% MAE modeled), hypertension (2.60% MAE crude, 1.48% MAE modeled), obesity (4.92% MAE crude, 4.07% MAE modeled), and smoking (5.33% MAE crude, 2.99% MAE modeled). Correlation between modeled estimates and BRFSS estimates for the 13 municipalities in Massachusetts covered by BRFSS’s 500 Cities ranged from 81.9% (obesity) to 96.7% (diabetes).

Conclusions

Small-area estimation using EHR data is feasible and generates estimates comparable to BRFSS state and small-area estimates. Integrating EHR data with survey data can provide timely and accurate disease monitoring tools for areas with sparse data coverage.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kim RS, Shankar V. Prevalence estimation by joint use of big data and health survey: a demonstration study using electronic health records in New York city. BMC Med Res Methodol. 2020;20:1–10.CrossRef Kim RS, Shankar V. Prevalence estimation by joint use of big data and health survey: a demonstration study using electronic health records in New York city. BMC Med Res Methodol. 2020;20:1–10.CrossRef
2.
go back to reference Perlman SE, McVeigh KH, Thorpe LE, Jacobson L, Greene CM, Gwynn RC. Innovations in population health surveillance: using electronic health Records for Chronic Disease Surveillance. Am J Public Health. 2017;107(6):853–7.CrossRef Perlman SE, McVeigh KH, Thorpe LE, Jacobson L, Greene CM, Gwynn RC. Innovations in population health surveillance: using electronic health Records for Chronic Disease Surveillance. Am J Public Health. 2017;107(6):853–7.CrossRef
4.
go back to reference Newton-Dame R, McVeigh KH, Schreibstein L, et al. Design of the New York City Macroscope: innovations in population health surveillance using electronic health records. EGEMS (Wash DC). 2016;4(1):1265. Newton-Dame R, McVeigh KH, Schreibstein L, et al. Design of the New York City Macroscope: innovations in population health surveillance using electronic health records. EGEMS (Wash DC). 2016;4(1):1265.
5.
go back to reference Vogel J, Brown JS, Land T, Platt R, Klompas M. MDPHnet: secure, distributed sharing of electronic health record data for public health surveillance, evaluation, and planning. Am J Public Health. 2014;104(12):2265–70.CrossRef Vogel J, Brown JS, Land T, Platt R, Klompas M. MDPHnet: secure, distributed sharing of electronic health record data for public health surveillance, evaluation, and planning. Am J Public Health. 2014;104(12):2265–70.CrossRef
6.
go back to reference Klompas M, Cocoros NM, Menchaca JT, et al. State and local chronic disease surveillance using electronic health record systems. Am J Public Health. 2017;107(9):1406–12.CrossRef Klompas M, Cocoros NM, Menchaca JT, et al. State and local chronic disease surveillance using electronic health record systems. Am J Public Health. 2017;107(9):1406–12.CrossRef
7.
go back to reference Li W, Kelsey JL, Zhang Z, et al. Small-area estimation and prioritizing communities for obesity control in Massachusetts. Am J Public Health. 2009;99(3):511–9.CrossRef Li W, Kelsey JL, Zhang Z, et al. Small-area estimation and prioritizing communities for obesity control in Massachusetts. Am J Public Health. 2009;99(3):511–9.CrossRef
8.
go back to reference Li W, Land T, Zhang Z, Keithly L, Kelsey JL. Small-area estimation and prioritizing communities for tobacco control efforts in Massachusetts. Am J Public Health. 2009;99(3):470–9.CrossRef Li W, Land T, Zhang Z, Keithly L, Kelsey JL. Small-area estimation and prioritizing communities for tobacco control efforts in Massachusetts. Am J Public Health. 2009;99(3):470–9.CrossRef
9.
go back to reference Zhang X, Holt JB, Lu H, et al. Multilevel regression and poststratification for small-area estimation of population health outcomes: a case study of chronic obstructive pulmonary disease prevalence using the behavioral risk factor surveillance system. Am J Epidemiol. 2014;179(8):1025–33.CrossRef Zhang X, Holt JB, Lu H, et al. Multilevel regression and poststratification for small-area estimation of population health outcomes: a case study of chronic obstructive pulmonary disease prevalence using the behavioral risk factor surveillance system. Am J Epidemiol. 2014;179(8):1025–33.CrossRef
10.
go back to reference Eke P, Zhang X, Lu H, et al. Predicting periodontitis at state and local levels in the United States. J Dent Res. 2016;95(5):515–22.CrossRef Eke P, Zhang X, Lu H, et al. Predicting periodontitis at state and local levels in the United States. J Dent Res. 2016;95(5):515–22.CrossRef
13.
go back to reference Wang WRD, Goel S, Gelman A. Forecasting elections with non-representative polls. Int J Forecast. 2015;31(3):980–91.CrossRef Wang WRD, Goel S, Gelman A. Forecasting elections with non-representative polls. Int J Forecast. 2015;31(3):980–91.CrossRef
14.
go back to reference Klompas M, Lazarus R, Daniel J, Haney G, Campion F, Kruskal B. Electronic medical record support for public health (ESP): automated detection and reporting of statutory notifiable diseases to public health authorities. Adv Dis Surv. 2007;3(3):1–5. Klompas M, Lazarus R, Daniel J, Haney G, Campion F, Kruskal B. Electronic medical record support for public health (ESP): automated detection and reporting of statutory notifiable diseases to public health authorities. Adv Dis Surv. 2007;3(3):1–5.
15.
go back to reference Cocoros NM, Ochoa A, Eberhardt K, Zambarano B, Klompas M. Denominators matter: understanding medical encounter frequency and its impact on surveillance estimates using EHR data. EGEMS (Wash DC). 2019;7(1):31. Cocoros NM, Ochoa A, Eberhardt K, Zambarano B, Klompas M. Denominators matter: understanding medical encounter frequency and its impact on surveillance estimates using EHR data. EGEMS (Wash DC). 2019;7(1):31.
17.
go back to reference Czajka JL, Beyler A. Background paper declining response rates in federal surveys: trends and implications. Mathematica Policy Res. 2016;1:1–86. Czajka JL, Beyler A. Background paper declining response rates in federal surveys: trends and implications. Mathematica Policy Res. 2016;1:1–86.
18.
go back to reference Crouch E, Radcliff E, Strompolis M, Hartley SN. Behavioral risk factor surveillance system state survey on exposure to adverse childhood experiences (ACEs): who declines to respond? Child Youth Serv Rev. 2018;91:259–62.CrossRef Crouch E, Radcliff E, Strompolis M, Hartley SN. Behavioral risk factor surveillance system state survey on exposure to adverse childhood experiences (ACEs): who declines to respond? Child Youth Serv Rev. 2018;91:259–62.CrossRef
Metadata
Title
Small-area estimation for public health surveillance using electronic health record data: reducing the impact of underrepresentation
Authors
Tom Chen
Wenjun Li
Bob Zambarano
Michael Klompas
Publication date
01-12-2022
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2022
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-022-13809-2

Other articles of this Issue 1/2022

BMC Public Health 1/2022 Go to the issue