Skip to main content
Top
Published in: Population Health Metrics 1/2011

Open Access 01-12-2011 | Research

Using funnel plots in public health surveillance

Authors: Douglas C Dover, Donald P Schopflocher

Published in: Population Health Metrics | Issue 1/2011

Login to get access

Abstract

Background

Public health surveillance is often concerned with the analysis of health outcomes over small areas. Funnel plots have been proposed as a useful tool for assessing and visualizing surveillance data, but their full utility has not been appreciated (for example, in the incorporation and interpretation of risk factors).

Methods

We investigate a way to simultaneously focus funnel plot analyses on direct policy implications while visually incorporating model fit and the effects of risk factors. Health survey data representing modifiable and nonmodifiable risk factors are used in an analysis of 2007 small area motor vehicle mortality rates in Alberta, Canada.

Results

Small area variations in motor vehicle mortality in Alberta were well explained by the suite of modifiable and nonmodifiable risk factors. Funnel plots of raw rates and of risk adjusted rates lead to different conclusions; the analysis process highlights opportunities for intervention as risk factors are incorporated into the model. Maps based on funnel plot methods identify areas worthy of further investigation.

Conclusions

Funnel plots provide a useful tool to explore small area data and to routinely incorporate covariate relationships in surveillance analyses. The exploratory process has at each step a direct and useful policy-related result. Dealing thoughtfully with statistical overdispersion is a cornerstone to fully understanding funnel plots.
Appendix
Available only for authorised users
Literature
1.
go back to reference CDC: Guidelines for evaluating surveillance systems. MMWR 1988.,37(S-5): CDC: Guidelines for evaluating surveillance systems. MMWR 1988.,37(S-5):
2.
go back to reference Woodall DH: The Use of Control Charts in Health-Care and Public-Health Surveillance. J Qual Technol 2006,38(2):89-104. Woodall DH: The Use of Control Charts in Health-Care and Public-Health Surveillance. J Qual Technol 2006,38(2):89-104.
3.
go back to reference Rogerson P, Yamada I: Statistical detection and surveillance of geographic clusters. Hoboken, NJ, Taylor & Francis; 2008.CrossRef Rogerson P, Yamada I: Statistical detection and surveillance of geographic clusters. Hoboken, NJ, Taylor & Francis; 2008.CrossRef
4.
go back to reference Marshall T, Mohamnmed MA, Rouse A: A randomized controlled trial of league tables and control charts as aids to health service decision-making. Int J Qual Health Care 2004,16(4):309-315. 10.1093/intqhc/mzh054CrossRefPubMed Marshall T, Mohamnmed MA, Rouse A: A randomized controlled trial of league tables and control charts as aids to health service decision-making. Int J Qual Health Care 2004,16(4):309-315. 10.1093/intqhc/mzh054CrossRefPubMed
5.
go back to reference Marshall CE, Spiegelhalter DJ: Reliability of league tables of in vitro fertilisation clinics: retrospective analysis of live birth rates. BMJ 1998, 316: 1701-1705. 10.1136/bmj.316.7146.1701CrossRefPubMedPubMedCentral Marshall CE, Spiegelhalter DJ: Reliability of league tables of in vitro fertilisation clinics: retrospective analysis of live birth rates. BMJ 1998, 316: 1701-1705. 10.1136/bmj.316.7146.1701CrossRefPubMedPubMedCentral
6.
go back to reference Shen W, Louis TA: Triple-goal estimates for disease mapping. Statistics in Medicine 2000, 19: 2295-2308. 10.1002/1097-0258(20000915/30)19:17/18<2295::AID-SIM570>3.0.CO;2-QCrossRefPubMed Shen W, Louis TA: Triple-goal estimates for disease mapping. Statistics in Medicine 2000, 19: 2295-2308. 10.1002/1097-0258(20000915/30)19:17/18<2295::AID-SIM570>3.0.CO;2-QCrossRefPubMed
7.
go back to reference Sui DZ, Holt JB: Visualizing and Analysing Public-Health Data Using Value-by-Area Cartograms: Toward a New Synthetic Framework. Cartographica 2008,43(1):3-20. 10.3138/carto.43.1.3CrossRef Sui DZ, Holt JB: Visualizing and Analysing Public-Health Data Using Value-by-Area Cartograms: Toward a New Synthetic Framework. Cartographica 2008,43(1):3-20. 10.3138/carto.43.1.3CrossRef
8.
go back to reference Light RJ, Pillemer DB: Summing up: the science of reviewing research. Cambridge, Mass., Harvard University Press; 1984. Light RJ, Pillemer DB: Summing up: the science of reviewing research. Cambridge, Mass., Harvard University Press; 1984.
9.
go back to reference Sterne JAC, Egger M, Smith GD: Investigating and dealing with publication and other biases in meta-analysis. BMJ 2001, 323: 101-105. 10.1136/bmj.323.7304.101CrossRefPubMedPubMedCentral Sterne JAC, Egger M, Smith GD: Investigating and dealing with publication and other biases in meta-analysis. BMJ 2001, 323: 101-105. 10.1136/bmj.323.7304.101CrossRefPubMedPubMedCentral
10.
go back to reference Benneyan JC, Lloyd RC, Plsek PE: Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care 2003, 12: 458-464. 10.1136/qhc.12.6.458CrossRefPubMedPubMedCentral Benneyan JC, Lloyd RC, Plsek PE: Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care 2003, 12: 458-464. 10.1136/qhc.12.6.458CrossRefPubMedPubMedCentral
11.
go back to reference Spiegelhalter DJ: Funnel plots for comparing institutional performance. Statistics in Medicine 2005, 24: 1185-2102. 10.1002/sim.1970CrossRefPubMed Spiegelhalter DJ: Funnel plots for comparing institutional performance. Statistics in Medicine 2005, 24: 1185-2102. 10.1002/sim.1970CrossRefPubMed
12.
go back to reference Iezzoni LI, (ed): Risk Adjustment for Measuring Health Care Outcomes. 3rd edition. Chicago, IL, Health Administration Press; 2003. Iezzoni LI, (ed): Risk Adjustment for Measuring Health Care Outcomes. 3rd edition. Chicago, IL, Health Administration Press; 2003.
15.
go back to reference Korn EL, Graubard BI: Analysis of Health Surveys. New York, NY, Wiley; 1999.CrossRef Korn EL, Graubard BI: Analysis of Health Surveys. New York, NY, Wiley; 1999.CrossRef
16.
go back to reference Rogerson P, Yamada I: Statistical Detection and Surveillance of Geographic Clusters. Boca Raton, FL, Chapman and Hall; 2008.CrossRef Rogerson P, Yamada I: Statistical Detection and Surveillance of Geographic Clusters. Boca Raton, FL, Chapman and Hall; 2008.CrossRef
17.
go back to reference Barss P, Smith GS, Baker SP, Mohan D: Injury prevention: an international perspective epidemiology, surveillance, and policy. New York, Oxford University Press; 1998. Barss P, Smith GS, Baker SP, Mohan D: Injury prevention: an international perspective epidemiology, surveillance, and policy. New York, Oxford University Press; 1998.
19.
go back to reference Birkmeyer JD: Primer on Geographic Variation in Health Care. Effective Clinical Practice 2001,4(5):232-233. Birkmeyer JD: Primer on Geographic Variation in Health Care. Effective Clinical Practice 2001,4(5):232-233.
20.
go back to reference Terrin N, Schmid CJ, Lau J: In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. Journal of Clinical Epidemiology 2005, 58: 894-901. 10.1016/j.jclinepi.2005.01.006CrossRefPubMed Terrin N, Schmid CJ, Lau J: In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. Journal of Clinical Epidemiology 2005, 58: 894-901. 10.1016/j.jclinepi.2005.01.006CrossRefPubMed
22.
go back to reference Kim H, Kriebel D: Regression models for public health surveillance data: a simulation study. Occup Environ Med 2009, 66: 733-739. 10.1136/oem.2008.042887CrossRefPubMed Kim H, Kriebel D: Regression models for public health surveillance data: a simulation study. Occup Environ Med 2009, 66: 733-739. 10.1136/oem.2008.042887CrossRefPubMed
23.
go back to reference Ohlssen DI, Sharples LD, Spiegelhalter DJ: A hierarchical modelling framework for identifying unusual performance in health care providers. J R Statist Soc A 2007, 170: 865-890. 10.1111/j.1467-985X.2007.00487.xCrossRef Ohlssen DI, Sharples LD, Spiegelhalter DJ: A hierarchical modelling framework for identifying unusual performance in health care providers. J R Statist Soc A 2007, 170: 865-890. 10.1111/j.1467-985X.2007.00487.xCrossRef
24.
go back to reference Berk R, MacDonald J: Overdispersion and Poisson Regression. Journal of Quantitative Criminology 2008, 24: 269-284. 10.1007/s10940-008-9048-4CrossRef Berk R, MacDonald J: Overdispersion and Poisson Regression. Journal of Quantitative Criminology 2008, 24: 269-284. 10.1007/s10940-008-9048-4CrossRef
25.
go back to reference Pires AN, Amado C: Interval estimators for a binomial proportion: comparison of twenty methods. Revstat 2008,6(2):165-197. Pires AN, Amado C: Interval estimators for a binomial proportion: comparison of twenty methods. Revstat 2008,6(2):165-197.
26.
go back to reference Rothman KJ, Greenland S, Lash TL: Modern Epidemiology. 3rd edition. Philadelphia, PA Lippincott Williams & Wilkins; 2008. Rothman KJ, Greenland S, Lash TL: Modern Epidemiology. 3rd edition. Philadelphia, PA Lippincott Williams & Wilkins; 2008.
Metadata
Title
Using funnel plots in public health surveillance
Authors
Douglas C Dover
Donald P Schopflocher
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2011
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/1478-7954-9-58

Other articles of this Issue 1/2011

Population Health Metrics 1/2011 Go to the issue