Skip to main content
Top
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Research article

A survey tool for measuring evidence-based decision making capacity in public health agencies

Authors: Julie A Jacobs, Paula F Clayton, Cassandra Dove, Tanya Funchess, Ellen Jones, Ghazala Perveen, Brandon Skidmore, Victor Sutton, Sarah Worthington, Elizabeth A Baker, Anjali D Deshpande, Ross C Brownson

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

While increasing attention is placed on using evidence-based decision making (EBDM) to improve public health, there is little research assessing the current EBDM capacity of the public health workforce. Public health agencies serve a wide range of populations with varying levels of resources. Our survey tool allows an individual agency to collect data that reflects its unique workforce.

Methods

Health department leaders and academic researchers collaboratively developed and conducted cross-sectional surveys in Kansas and Mississippi (USA) to assess EBDM capacity. Surveys were delivered to state- and local-level practitioners and community partners working in chronic disease control and prevention. The core component of the surveys was adopted from a previously tested instrument and measured gaps (importance versus availability) in competencies for EBDM in chronic disease. Other survey questions addressed expectations and incentives for using EBDM, self-efficacy in three EBDM skills, and estimates of EBDM within the agency.

Results

In both states, participants identified communication with policymakers, use of economic evaluation, and translation of research to practice as top competency gaps. Self-efficacy in developing evidence-based chronic disease control programs was lower than in finding or using data. Public health practitioners estimated that approximately two-thirds of programs in their agency were evidence-based. Mississippi participants indicated that health department leaders' expectations for the use of EBDM was approximately twice that of co-workers' expectations and that the use of EBDM could be increased with training and leadership prioritization.

Conclusions

The assessment of EBDM capacity in Kansas and Mississippi built upon previous nationwide findings to identify top gaps in core competencies for EBDM in chronic disease and to estimate a percentage of programs in U.S. health departments that are evidence-based. The survey can serve as a valuable tool for other health departments and non-governmental organizations to assess EBDM capacity within their own workforce and to assist in the identification of approaches that will enhance the uptake of EBDM processes in public health programming and policymaking. Localized survey findings can provide direction for focusing workforce training programs and can indicate the types of incentives and policies that could affect the culture of EBDM in the workplace.
Appendix
Available only for authorised users
Literature
2.
go back to reference Kung HC, Hoyert DL, Xu J, Murphy SL: Deaths: final data for 2005. Natl Vital Stat Rep. 2008, 56: 1-120.PubMed Kung HC, Hoyert DL, Xu J, Murphy SL: Deaths: final data for 2005. Natl Vital Stat Rep. 2008, 56: 1-120.PubMed
3.
4.
go back to reference Danaei G, Ding EL, Mozaffarian D, Taylor B, Rehm J, Murray CJ, Ezzati M: The preventable causes of death in the United States: comparative risk assessment of dietary, lifestyle, and metabolic risk factors. PLoS Med. 2009, 6 (4): e1000058-10.1371/journal.pmed.1000058.CrossRefPubMedPubMedCentral Danaei G, Ding EL, Mozaffarian D, Taylor B, Rehm J, Murray CJ, Ezzati M: The preventable causes of death in the United States: comparative risk assessment of dietary, lifestyle, and metabolic risk factors. PLoS Med. 2009, 6 (4): e1000058-10.1371/journal.pmed.1000058.CrossRefPubMedPubMedCentral
5.
go back to reference Mokdad AH: Actual causes of death in the United States, 2000. JAMA. 2004, 291 (10): 1238-1245. 10.1001/jama.291.10.1238.CrossRefPubMed Mokdad AH: Actual causes of death in the United States, 2000. JAMA. 2004, 291 (10): 1238-1245. 10.1001/jama.291.10.1238.CrossRefPubMed
6.
go back to reference Brownson RC, Baker EA, Leet TL, Gillespie KN, True WR: Evidence-Based Public Health. 2011, New York: Oxford University Press, 2 Brownson RC, Baker EA, Leet TL, Gillespie KN, True WR: Evidence-Based Public Health. 2011, New York: Oxford University Press, 2
7.
go back to reference Fielding JE, Briss PA: Promoting evidence-based public health policy: can we have better evidence and more action?. Health Aff (Millwood). 2006, 25 (4): 969-978. 10.1377/hlthaff.25.4.969.CrossRef Fielding JE, Briss PA: Promoting evidence-based public health policy: can we have better evidence and more action?. Health Aff (Millwood). 2006, 25 (4): 969-978. 10.1377/hlthaff.25.4.969.CrossRef
8.
go back to reference Wilson KM, Brady TJ, Lesesne C: on behalf of the NCCDPHP Work Group on Translation: an organizing framework for translation in public health: the knowledge to action framework. Prev Chronic Dis. 2011, 8 (2): 1-7. Wilson KM, Brady TJ, Lesesne C: on behalf of the NCCDPHP Work Group on Translation: an organizing framework for translation in public health: the knowledge to action framework. Prev Chronic Dis. 2011, 8 (2): 1-7.
10.
go back to reference Zaza S, Briss PA, Harris KW: The Guide to Community Preventive Services: What Works to Promote Health?. 2005, New York: Oxford University Press Zaza S, Briss PA, Harris KW: The Guide to Community Preventive Services: What Works to Promote Health?. 2005, New York: Oxford University Press
11.
go back to reference Brownson RC, Fielding JE, Maylahn CM: Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009, 30: 175-201. 10.1146/annurev.publhealth.031308.100134.CrossRefPubMed Brownson RC, Fielding JE, Maylahn CM: Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009, 30: 175-201. 10.1146/annurev.publhealth.031308.100134.CrossRefPubMed
12.
go back to reference Satterfield JM, Spring B, Brownson RC, Mullen EJ, Newhouse RP, Walker BB, Whitlock EP: Toward a transdisciplinary model of evidence-based practice. Milbank Quarterly. 2009, 87 (2): 368-90. 10.1111/j.1468-0009.2009.00561.x.CrossRefPubMedPubMedCentral Satterfield JM, Spring B, Brownson RC, Mullen EJ, Newhouse RP, Walker BB, Whitlock EP: Toward a transdisciplinary model of evidence-based practice. Milbank Quarterly. 2009, 87 (2): 368-90. 10.1111/j.1468-0009.2009.00561.x.CrossRefPubMedPubMedCentral
13.
go back to reference Green LW, Ottoson JM, Garcia C, Hiatt RA: Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health. 2009, 30: 151-74. 10.1146/annurev.publhealth.031308.100049.CrossRefPubMed Green LW, Ottoson JM, Garcia C, Hiatt RA: Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health. 2009, 30: 151-74. 10.1146/annurev.publhealth.031308.100049.CrossRefPubMed
14.
go back to reference Graham IA, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.CrossRefPubMed Graham IA, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.CrossRefPubMed
15.
go back to reference Lavis JN: Research, public policymaking, and knowledge-translation processes: Canadian efforts to build bridges. J Contin Educ Health Prof. 2006, 26: 37-45. 10.1002/chp.49.CrossRefPubMed Lavis JN: Research, public policymaking, and knowledge-translation processes: Canadian efforts to build bridges. J Contin Educ Health Prof. 2006, 26: 37-45. 10.1002/chp.49.CrossRefPubMed
16.
go back to reference Dobbins M, Ciliska D, Cockerill R, Barnsley J, DiCenso A: A framework for the dissemination and utilization of research for health-care policy and practice. Online J Knowl Synth Nurs. 2002, 9 (7). Dobbins M, Ciliska D, Cockerill R, Barnsley J, DiCenso A: A framework for the dissemination and utilization of research for health-care policy and practice. Online J Knowl Synth Nurs. 2002, 9 (7).
17.
go back to reference Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28 (Suppl 5): 226-230.CrossRefPubMed Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28 (Suppl 5): 226-230.CrossRefPubMed
18.
go back to reference Kerner JF: Integrating research, practice, and policy: what we see depends on where we stand. J Public Health Management Practice. 2008, 14 (2): 193-198.CrossRef Kerner JF: Integrating research, practice, and policy: what we see depends on where we stand. J Public Health Management Practice. 2008, 14 (2): 193-198.CrossRef
19.
go back to reference Baker EA, Brownson RC, Dreisinger M, McIntosh LD, Karamehic-Muratovic A: Examining the role of training in evidence-based public health: a qualitative study. Health Promot Pract. 2009, 10: 342-348. 10.1177/1524839909336649.CrossRefPubMed Baker EA, Brownson RC, Dreisinger M, McIntosh LD, Karamehic-Muratovic A: Examining the role of training in evidence-based public health: a qualitative study. Health Promot Pract. 2009, 10: 342-348. 10.1177/1524839909336649.CrossRefPubMed
20.
go back to reference Baker EL, Potter MA, Jones DL, Mercer SL, Cioffi JP, Green LW, Halverson PK, Lichtveld MY, Fleming DW: The public health infrastructure and our nation's health. Annu Rev Public Health. 2005, 26: 303-318. 10.1146/annurev.publhealth.26.021304.144647.CrossRefPubMed Baker EL, Potter MA, Jones DL, Mercer SL, Cioffi JP, Green LW, Halverson PK, Lichtveld MY, Fleming DW: The public health infrastructure and our nation's health. Annu Rev Public Health. 2005, 26: 303-318. 10.1146/annurev.publhealth.26.021304.144647.CrossRefPubMed
21.
go back to reference Brownson RC, Ballew P, Dieffenderfer B, Haire-Joshu D, Heath GW, Kreuter MW, Myers BA: Evidence-based interventions to promote physical activity: what contributes to dissemination by state health departments. Am J Prev Med. 2007, 33 (Suppl 1): 66-73.CrossRef Brownson RC, Ballew P, Dieffenderfer B, Haire-Joshu D, Heath GW, Kreuter MW, Myers BA: Evidence-based interventions to promote physical activity: what contributes to dissemination by state health departments. Am J Prev Med. 2007, 33 (Suppl 1): 66-73.CrossRef
22.
go back to reference Dodson EA, Baker EA, Brownson RC: Use of evidence-based interventions in state health departments: a qualitative assessment of barriers and solutions. J Public Health Manag Pract. 2010, 16 (6): E9-E15.CrossRefPubMed Dodson EA, Baker EA, Brownson RC: Use of evidence-based interventions in state health departments: a qualitative assessment of barriers and solutions. J Public Health Manag Pract. 2010, 16 (6): E9-E15.CrossRefPubMed
23.
go back to reference Jacobs JA, Dodson EA, Baker EA, Deshpande AD, Brownson RC: Barriers to evidence-based decision making in public health: a national survey of chronic disease practitioners. Public Health Rep. 2010, 125: 736-742.PubMedPubMedCentral Jacobs JA, Dodson EA, Baker EA, Deshpande AD, Brownson RC: Barriers to evidence-based decision making in public health: a national survey of chronic disease practitioners. Public Health Rep. 2010, 125: 736-742.PubMedPubMedCentral
24.
go back to reference Dodson EA: Personal and organizational barriers to evidence-based decision making among U.S. chronic disease practitioners. Presented at: Cultivating Health Communities: 20th National Conference on Chronic Disease Prevention and Control, Centers for Disease Control and Prevention. 2009, National Harbor, MD Dodson EA: Personal and organizational barriers to evidence-based decision making among U.S. chronic disease practitioners. Presented at: Cultivating Health Communities: 20th National Conference on Chronic Disease Prevention and Control, Centers for Disease Control and Prevention. 2009, National Harbor, MD
25.
go back to reference McGowan A, Brownson R, Wilcox L, Mensah G: Prevention and control of chronic diseases. In Law in Public Health Practice. Edited by: Goodman R, Rothstein M, Hoffman R, Lopez W, Matthews G. 2006, New York: Oxford University Press, 2 McGowan A, Brownson R, Wilcox L, Mensah G: Prevention and control of chronic diseases. In Law in Public Health Practice. Edited by: Goodman R, Rothstein M, Hoffman R, Lopez W, Matthews G. 2006, New York: Oxford University Press, 2
28.
go back to reference Mays GP, Scutchfield FD, Bhandari MW, Smith SA: Understanding the organization of public health delivery systems: an empirical typology. Milbank Q. 2010, 88 (1): 81-111. 10.1111/j.1468-0009.2010.00590.x.CrossRefPubMedPubMedCentral Mays GP, Scutchfield FD, Bhandari MW, Smith SA: Understanding the organization of public health delivery systems: an empirical typology. Milbank Q. 2010, 88 (1): 81-111. 10.1111/j.1468-0009.2010.00590.x.CrossRefPubMedPubMedCentral
29.
go back to reference Mays GP, Smith SA, Ingram RC, Racster LJ, Lamberth CD, Lovely ES: Public health delivery systems: evidence, uncertainty, and emerging research needs. Am J Prev Med. 2009, 36 (3): 256-65. 10.1016/j.amepre.2008.11.008.CrossRefPubMed Mays GP, Smith SA, Ingram RC, Racster LJ, Lamberth CD, Lovely ES: Public health delivery systems: evidence, uncertainty, and emerging research needs. Am J Prev Med. 2009, 36 (3): 256-65. 10.1016/j.amepre.2008.11.008.CrossRefPubMed
30.
go back to reference Van Wave TW, Scutchfield FD, Honore PA: Recent advances in public health systems research in the United States. Annu Rev Public Health. 2010, 31: 283-95. 10.1146/annurev.publhealth.012809.103550.CrossRefPubMed Van Wave TW, Scutchfield FD, Honore PA: Recent advances in public health systems research in the United States. Annu Rev Public Health. 2010, 31: 283-95. 10.1146/annurev.publhealth.012809.103550.CrossRefPubMed
31.
go back to reference Fielding JE, Frieden TR: Local knowledge to enable local action. Am J Prev Med. 2004, 27 (2): 183-184. 10.1016/j.amepre.2004.04.010.CrossRefPubMed Fielding JE, Frieden TR: Local knowledge to enable local action. Am J Prev Med. 2004, 27 (2): 183-184. 10.1016/j.amepre.2004.04.010.CrossRefPubMed
33.
go back to reference Brownson RC, Ballew P, Kittur ND, Elliott MB, Haire-Joshu D, Krebill H, Kreuter MW: Developing competencies for training practitioners in evidence-based cancer control. J Cancer Educ. 2009, 24: 186-193. 10.1080/08858190902876395.CrossRefPubMed Brownson RC, Ballew P, Kittur ND, Elliott MB, Haire-Joshu D, Krebill H, Kreuter MW: Developing competencies for training practitioners in evidence-based cancer control. J Cancer Educ. 2009, 24: 186-193. 10.1080/08858190902876395.CrossRefPubMed
35.
go back to reference Dillman D: Mail and Internet Surveys: The Tailored Method. 2000, New York: Wiley, 2 Dillman D: Mail and Internet Surveys: The Tailored Method. 2000, New York: Wiley, 2
42.
go back to reference Adily A, Ward J: Evidence based practice in population health: a regional survey to inform workforce development and organizational change. J Epidemiol Community Health. 2004, 58: 455-460. 10.1136/jech.2003.012278.CrossRefPubMedPubMedCentral Adily A, Ward J: Evidence based practice in population health: a regional survey to inform workforce development and organizational change. J Epidemiol Community Health. 2004, 58: 455-460. 10.1136/jech.2003.012278.CrossRefPubMedPubMedCentral
43.
go back to reference Adily A, Ward J: Enhancing evidence-based practice in population health: staff views, barriers and strategies for change. Aust Health Rev. 2005, 29 (4): 469-477. 10.1071/AH050469.CrossRefPubMed Adily A, Ward J: Enhancing evidence-based practice in population health: staff views, barriers and strategies for change. Aust Health Rev. 2005, 29 (4): 469-477. 10.1071/AH050469.CrossRefPubMed
44.
go back to reference Maxwell ML, Adily A, Ward JE: Promoting evidence-based practice in population health the local level: a case study in workforce capacity development. Aust Health Rev. 2007, 31 (3): 422-429. 10.1071/AH070422.CrossRefPubMed Maxwell ML, Adily A, Ward JE: Promoting evidence-based practice in population health the local level: a case study in workforce capacity development. Aust Health Rev. 2007, 31 (3): 422-429. 10.1071/AH070422.CrossRefPubMed
45.
go back to reference Turnock BJ: Public Health: What It Is and How It Works. 2009, Sadbury, MA: Jones and Bartlett Publishers Turnock BJ: Public Health: What It Is and How It Works. 2009, Sadbury, MA: Jones and Bartlett Publishers
46.
go back to reference Gebbie KM: Public health certification. Annu Rev Public Health. 2009, 30: 203-10. 10.1146/annurev.publhealth.031308.100057.CrossRefPubMed Gebbie KM: Public health certification. Annu Rev Public Health. 2009, 30: 203-10. 10.1146/annurev.publhealth.031308.100057.CrossRefPubMed
47.
go back to reference Tilson H, Gebbie KM: The public health workforce. Annu Rev Public Health. 2004, 25: 341-356. 10.1146/annurev.publhealth.25.102802.124357.CrossRefPubMed Tilson H, Gebbie KM: The public health workforce. Annu Rev Public Health. 2004, 25: 341-356. 10.1146/annurev.publhealth.25.102802.124357.CrossRefPubMed
48.
go back to reference Koo D, Miner K: Outcome-based workforce development and education in public health. Annu Rev Public Health. 2010, 31: 253-69. 10.1146/annurev.publhealth.012809.103705.CrossRefPubMed Koo D, Miner K: Outcome-based workforce development and education in public health. Annu Rev Public Health. 2010, 31: 253-69. 10.1146/annurev.publhealth.012809.103705.CrossRefPubMed
49.
go back to reference Dreisinger M, Leet TL, Baker EA, Gillespie KN, Haas B, Brownson RC: Improving the public health workforce: evaluation of a training course to enhance evidence-based decision making. J Public Health Manag Pract. 2008, 14: 138-143.CrossRefPubMed Dreisinger M, Leet TL, Baker EA, Gillespie KN, Haas B, Brownson RC: Improving the public health workforce: evaluation of a training course to enhance evidence-based decision making. J Public Health Manag Pract. 2008, 14: 138-143.CrossRefPubMed
50.
go back to reference Brownson RC, Diem G, Grabauskas V, Legetic B, Potemkina R, Shatchkute A, Baker EA, Campbell CR, Leet TL, Nissinen A, Siegel PZ, Stachenko S, True WR, Waller M: Training practitioners in evidence-based chronic disease prevention for global health. Promot Educ. 2007, 14 (3): 159-163.PubMed Brownson RC, Diem G, Grabauskas V, Legetic B, Potemkina R, Shatchkute A, Baker EA, Campbell CR, Leet TL, Nissinen A, Siegel PZ, Stachenko S, True WR, Waller M: Training practitioners in evidence-based chronic disease prevention for global health. Promot Educ. 2007, 14 (3): 159-163.PubMed
51.
go back to reference Franks AL, Brownson RC, Bryant C, Brown KM, Hooker SP, Pluto DM, Shepard DM, Pate RR, Baker EA, Gillespie KN, Leet TL, O'Neall MA, Simoes J: Prevention Research Centers: contributions to updating the public health workforce through training. Prev Chronic Dis. 2005, 2 (2): A26.PubMedPubMedCentral Franks AL, Brownson RC, Bryant C, Brown KM, Hooker SP, Pluto DM, Shepard DM, Pate RR, Baker EA, Gillespie KN, Leet TL, O'Neall MA, Simoes J: Prevention Research Centers: contributions to updating the public health workforce through training. Prev Chronic Dis. 2005, 2 (2): A26.PubMedPubMedCentral
52.
go back to reference Dobbins M, Roberson , Ciliska D, Hanna S, Cameron R, O'Mara L, DeCorby K, Mercer S: A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. Implement Sci. 2009, 4: 23-10.1186/1748-5908-4-23.CrossRefPubMedPubMedCentral Dobbins M, Roberson , Ciliska D, Hanna S, Cameron R, O'Mara L, DeCorby K, Mercer S: A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. Implement Sci. 2009, 4: 23-10.1186/1748-5908-4-23.CrossRefPubMedPubMedCentral
53.
go back to reference Aarons G, Horowitz J, Dlugosz L, Ehrhart M: The role of organizational processes in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson RC, Colditz GA, Proctor EK. 2012, New York: Oxford University Press. Aarons G, Horowitz J, Dlugosz L, Ehrhart M: The role of organizational processes in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson RC, Colditz GA, Proctor EK. 2012, New York: Oxford University Press.
Metadata
Title
A survey tool for measuring evidence-based decision making capacity in public health agencies
Authors
Julie A Jacobs
Paula F Clayton
Cassandra Dove
Tanya Funchess
Ellen Jones
Ghazala Perveen
Brandon Skidmore
Victor Sutton
Sarah Worthington
Elizabeth A Baker
Anjali D Deshpande
Ross C Brownson
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-57

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue