Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Understanding evidence: a statewide survey to explore evidence-informed public health decision-making in a local government setting

Authors: Rebecca Armstrong, Elizabeth Waters, Laurence Moore, Maureen Dobbins, Tahna Pettman, Cate Burns, Boyd Swinburn, Laurie Anderson, Mark Petticrew

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

The value placed on types of evidence within decision-making contexts is highly dependent on individuals, the organizations in which the work and the systems and sectors they operate in. Decision-making processes too are highly contextual. Understanding the values placed on evidence and processes guiding decision-making is crucial to designing strategies to support evidence-informed decision-making (EIDM). This paper describes how evidence is used to inform local government (LG) public health decisions.

Methods

The study used mixed methods including a cross-sectional survey and interviews. The Evidence-Informed Decision-Making Tool (EvIDenT) survey was designed to assess three key domains likely to impact on EIDM: access, confidence, and organizational culture. Other elements included the usefulness and influence of sources of evidence (people/groups and resources), skills and barriers, and facilitators to EIDM. Forty-five LGs from Victoria, Australia agreed to participate in the survey and up to four people from each organization were invited to complete the survey (n = 175). To further explore definitions of evidence and generate experiential data on EIDM practice, key informant interviews were conducted with a range of LG employees working in areas relevant to public health.

Results

In total, 135 responses were received (75% response rate) and 13 interviews were conducted. Analysis revealed varying levels of access, confidence and organizational culture to support EIDM. Significant relationships were found between domains: confidence, culture and access to research evidence. Some forms of evidence (e.g. community views) appeared to be used more commonly and at the expense of others (e.g. research evidence). Overall, a mixture of evidence (but more internal than external evidence) was influential in public health decision-making in councils. By comparison, a mixture of evidence (but more external than internal evidence) was deemed to be useful in public health decision-making.

Conclusions

This study makes an important contribution to understanding how evidence is used within the public health LG context.

Trial registration

ACTRN12609000953235.
Appendix
Available only for authorised users
Literature
1.
Bowen S, Martens P: Demystifying knowledge translation: learning from the community. J Health Serv Res Policy. 2005, 10 (4): 203-211. 10.1258/135581905774414213.CrossRefPubMed
2.
Ciliska D, Thomas H, Buffett C: An Introduction to Evidence-Informed Public Health and a Compendium of Critical Appraisal Tools for Public Health Practice. 2008, Hamilton, ON: ational Collaborating Centre for Methods and Tools
3.
Tannahill A: Beyond evidence—to ethics: a decision-making framework for health promotion, public health and health improvement†. Health Promot Int. 2008, 23 (4): 380-390. 10.1093/heapro/dan032.CrossRefPubMed
4.
Lavis JN, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (suppl 1): 35-48. 10.1258/1355819054308549.CrossRefPubMed
5.
Orton L, Lloyd-Williams F, Taylor-Robinson D, O’Flaherty M, Capewell S: The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6 (7): e21704-10.1371/journal.pone.0021704.CrossRefPubMedPubMedCentral
6.
Jewell CJ, Bero LA: ‘Developing good taste in evidence’: facilitators of and hindrances to evidence-informed health policymaking in state government. Milbank Q. 2008, 86 (2): 177-208. 10.1111/j.1468-0009.2008.00519.x.CrossRefPubMedPubMedCentral
7.
Kohatsu ND, Robinson JGTJC: Evidence-based public health: an evolving concept. Am J Prev Med. 2004, 27: 415-421.
8.
Moore G, Redman S, Haines M, Todd A: What works to increase the use of research in population health policy and programmes: a review. Evid Policy. 2011, 7 (3): 277-305. 10.1332/174426411X579199.CrossRef
9.
Mitton C, Adair CE, McKenzie E, Patten SB, Waye Perry B: Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007, 85 (4): 729-768. 10.1111/j.1468-0009.2007.00506.x.CrossRefPubMedPubMedCentral
10.
LaRocca R, Yost J, Dobbins M, Ciliska D, Butt M: The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health. 2012, 12 (1): 751-10.1186/1471-2458-12-751.CrossRefPubMedPubMedCentral
11.
Morse J: In Principles of Mixed Methods and Multi-Method Research Design. Handbook of Mixed Methods in Social and Behavioural Research. Edited by: Tashakkori A, Teddlie C. 2003, Sage Publications, California,
12.
Creswell J, Plano Clark VL, Guttmann ML, Hanson WE: In Advanced Mixed Methods Research Designs. Handbook of Mixed Methods in Social and Behavioural Research. Edited by: Tashakkori A, Teddlie C. 2003, Sage Publications, California,
13.
Collins KM, Onwuegbuzie AJ, Jiao QG: Toward a Broader Understanding of Stress and Coping: Mixed Methods Approaches. 2010, Information Age Publishing, Charlotte NC
14.
Estabrooks CA, Thompson DS, Lovely JE, Hofmeyer A: A guide to knowledge translation theory. J Contin Educ Health Prof. 2006, 26 (1): 25-36. 10.1002/chp.48.CrossRefPubMed
15.
Dobbins M, Cockerill R, Barnsley J: Factors affecting the utilization of systematic reviews. Int J Technol Assess Health Care. 2001, 17: 2-10.1017/S0266462300105069.CrossRef
16.
Nutley SM, Walter I, Davies H: Using Evidence: How Research can Inform Public Services. 2007, The Policy Press, Bristol
17.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou : Diffusion of innovations in service organisations: systematic review and recommendations. Millbank Quarterly. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRef
18.
Dobrow MJ, Goel V, Upshur RE: Evidence-based health policy: context and utilisation. Soc Sci Med. 2004, 58 (1): 207-217. 10.1016/S0277-9536(03)00166-7.CrossRefPubMed
19.
Hanney SR, Gonzalez-Block M, Buxton MJ, Kogan M: The utilization of health services research in policy-making: concepts, examples and methods of assessment. Health Res Policy Sys. 2003, 1: 2-10.1186/1478-4505-1-2.CrossRef
20.
Green LW, Ottoson JM, Garcia C, Hiatt RA: Diffusion theory, and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health. 2009, 30: 151-174. 10.1146/annurev.publhealth.031308.100049.CrossRefPubMed
21.
Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26 (1): 13-24. 10.1002/chp.47.CrossRefPubMed
22.
Sudsawad P: Knowledge Translation: Introduction to Models, Strategies, and Measures. 2007, Southwest Educational Development Laboratory, National Center for the Dissemination of Disability Research, Austin, TX
23.
Lavis JN, Lomas J, Hamid M, Sewankambo NK: Assessing country-level efforts to link research to action. Bull World Health Organ. 2006, 84 (8): 620-628. 10.2471/BLT.06.030312.CrossRefPubMedPubMedCentral
24.
Weatherly H, Drummond M, Smith D: Using evidence in the development of local health policies. Some evidence from the United Kingdom. Int J Technol Assess Health Care. 2002, 18 (4): 771-781. 10.1017/S0266462302000582.CrossRefPubMed
25.
Dobbins M: Knowledge Translation and Exchange Questionnaire. 2004, Canada, Canadian Institute for Health Research
26.
Armstrong R: Evidence-Informed Public Health Decision-Making in Local Government. Melbourne School of Public Health. 2011, University of Melbourne, Melbourne, Victoria
27.
Waters E, Armstrong R, Swinburn B, Moore L, Dobbins M, Anderson L, Petticrew M, Clark R, Conning R, Moodie M, Carter R: An exploratory cluster randomised controlled trial of knowledge translation strategies to support evidence-informed decision-making in local governments (the KT4LG study). BMC Public Health. 2011, 11: 34-10.1186/1471-2458-11-34.CrossRefPubMedPubMedCentral
28.
Department of Health and Ageing: Media Release; Grants Announced for Research into Preventive Health Reform), Joint release by The Hon Tanya Plibersek MP (Minister for Health) and The Hon Mark Butler MP (Minister for Social Inclusion, Minister for Mental Health and Ageing, Minister Assisting the Prime Minister on Mental Health. 2012. Cited 2013 18 March.
29.
SurveyMonkey.com: SurveyMonkey.com. 1999. 1999–2009.
30.
StataCorp LP: Stata 10.1. 2009, StataCorp LP, TX, USA
31.
32.
Onwuegbuzie AJ, Teddlie C: In A Framework for Analyzing Data in Mixed Methods Research. Handbook of Mixed Methods in Social and Behavioural Research. Edited by: Tashakkori A, Teddlie C. 2003, Sage Publications, California,
33.
Onwuegbuzie AJLNL: Linking research questions to mixed methods data analysis procedures. Qual Rep. 2006, 11 (3): 474-498.
34.
Kirkwood BR, Sterne JAC: Essential Medical Statistics. 2005, Blackwell Science, Massachusetts, 2
35.
Moore L: General practitioners’ Prescribing Behaviour: Analysis of GP Attitudes, Behaviour and Prescribing Costs, in London School of Hygiene and Tropical Medicine. 1999, University of London, London
36.
Liamputtong P, Ezzy D: Making sense of qualitative data: analysis process. Qualitative Research Methods. Edited by: Liamputtong P, Ezzy D. 2005, Oxford University Press, South Melbourne
37.
Dye J, Schatz IM, Rosenberg BA, Coleman ST: Constant comparison method: a kaleidoscope of data.Q Repor 2000, 4(1/2).,
38.
Liamputtong P, Ezzy D: Qualitative Research Methods. 2005, Oxford University Press, Melbourne, 2
39.
Oxman AD, Fretheim A, Lavis JN, Lewin S: SUPPORT tools for evidence-informed health policymaking (STP) 12: finding and using research evidence about resource use and costs. Health Res Policy Syst. 2009, 7 (Suppl 1): S12-10.1186/1478-4505-7-S1-S12.CrossRefPubMedPubMedCentral
40.
Macintyre S, Petticrew M: Good intentions and received wisdom are not enough. J Epidemiol Community Health. 2000, 54 (11): 802-803. 10.1136/jech.54.11.802.CrossRefPubMedPubMedCentral
41.
Nelson G, Macnaughton E, Goering P, Dudley M, O'Campo P, Patterson M, Piat M, Prevost N, Strehlau V, Vallee C: Planning a multi-site, complex intervention for homeless people with mental illness: the relationships between the national team and local sites in Canada's at home/chez Soi project. Am J Community Psychol. 2012, 51 (3–4): 347-358.
42.
Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M: A glossary for evidence based public health. J Epidemiol Community Health. 2004, 58 (7): 538-545. 10.1136/jech.2003.011585.CrossRefPubMedPubMedCentral
43.
Armstrong R, Pettman TL, Waters E: Shifting sands—from descriptions to solutions. Public Health. 2014, 128 (6): 525-532. 10.1016/j.puhe.2014.03.013.CrossRefPubMed
44.
Oxman AD, Lavis JN, Lewin S, Fretheim A: SUPPORT tools for evidence-informed health policymaking (STP) 1: what is evidence-informed policymaking?. Health Res Policy Syst. 2009, 7 (Suppl 1): S1-10.1186/1478-4505-7-S1-S1.CrossRefPubMedPubMedCentral
45.
Brownson RC, Gurney JG, Land GH: Evidence-based decision making in public health. J Public Health Manag Pract. 1999, 5 (5): 86-97. 10.1097/00124784-199909000-00012.CrossRefPubMed
46.
Oxman AD, Lavis JN, Fretheim, Lewin S: SUPPORT tools for evidence-informed health policymaking (STP) 17: dealing with insufficient research evidence.Health Res Policy Syst 2009, 7(Suppl 1):S17,
47.
Bero LA, Jadad AR: How consumers and policymakers can use systematic reviews for decision making. Ann Intern Med. 1997, 127 (1): 37-42. 10.7326/0003-4819-127-1-199707010-00007.CrossRefPubMed
48.
Lomas J: Using ‘linkage and exchange’ to move research into policy at a Canadian foundation. Health Aff. 2000, 19 (3): 236-240. 10.1377/hlthaff.19.3.236.CrossRef
49.
Mitchell P, Pirkis J, Hall J, Haas M: Partnerships for knowledge exchange in health services research, policy and practice. J Health Serv Res Policy. 2009, 14 (2): 104-111. 10.1258/jhsrp.2008.008091.CrossRefPubMed
50.
Brownson RC, Fielding JE, Maylahn CM: Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009, 30: 175-201. 10.1146/annurev.publhealth.031308.100134.CrossRefPubMed
51.
Almeida C, Bascolo E: Use of research results in policy decision-making, formulation, and implementation: a review of the literature. Cadernos Saude Publica. 2006, 22 (Suppl): S7-S19. discussion S20-33
52.
Waitzkin H, Hubbell FA: Truth's search for power in health policy: critical applications to community-oriented primary care and small area analysis. Med Care Res Rev. 1992, 49 (2): 161-189. 10.1177/002570879204900203.CrossRef
53.
Dobbins M, Rosenbaum P, Plews N, Law M, Fysh A: Information transfer: what do decision makers want and need from researchers?. Implement Sci. 2007, 2: 20-10.1186/1748-5908-2-20.CrossRefPubMedPubMedCentral
54.
Innvaer S, Vist G, Trommald M, Oxman A: Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244. 10.1258/135581902320432778.CrossRefPubMed
55.
Tetroe J, Graham ID, Foy R, Robinson N, Eccles MP, Wensing M, Durieux P, Legare F, Nielson CP, Adily A, Ward JE, Porter C, Shea B, Grimshaw JM: Health research funding agencies’ support and promotion of knowledge translation: an international study. Milbank Q. 2008, 86 (1): 125-155. 10.1111/j.1468-0009.2007.00515.x.CrossRefPubMedPubMedCentral
56.
Peirson L, Ciliska D, Dobbins M, Mowat D: Building capacity for evidence informed decision making in public health: a case study of organizational change. BMC Public Health. 2012, 12: 137-137. 10.1186/1471-2458-12-137.CrossRefPubMedPubMedCentral
57.
Dobbins M, Hanna S, Ciliska D, Manske S, Cameron R, Mercer S, O'Mara L, DeCorby K, Robeson P: A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implement Sci. 2009, 4 (1): 61-10.1186/1748-5908-4-61.CrossRefPubMedPubMedCentral
58.
Kothari A, Edwards N, Hamel N, Judd M:Is research working for you? Validating a tool to examine the capacity of health organizations to use research. Implement Sci. 2009, 4 (1): 46-10.1186/1748-5908-4-46.CrossRefPubMedPubMedCentral
Metadata
Title
Understanding evidence: a statewide survey to explore evidence-informed public health decision-making in a local government setting
Authors
Rebecca Armstrong
Elizabeth Waters
Laurence Moore
Maureen Dobbins
Tahna Pettman
Cate Burns
Boyd Swinburn
Laurie Anderson
Mark Petticrew
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-014-0188-7

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue

Research

Assessing organizational readiness for depression care quality improvement: relative commitment and implementation capability

Study protocol

Implementation of the epilepsy center of excellence to improve access to and quality of care – protocol for a mixed methods study

Research

Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS)

Research

Translating evidence-based interventions for implementation: Experiences from Project HEAL in African American churches

Study protocol

The development of an online decision support tool for organizational readiness for change

Systematic review

A systematic review of the quality of reporting in published smoking cessation trials for pregnant women: an explanation for the evidence-practice gap?