Skip to main content
Top
Published in: BMC Public Health 1/2014

Open Access 01-12-2014 | Research article

Measuring use of research evidence in public health policy: a policy content analysis

Authors: Pauline Zardo, Alex Collie

Published in: BMC Public Health | Issue 1/2014

Login to get access

Abstract

Background

There are few Australian studies showing how research evidence is used to inform the development of public health policy. International research has shown that compensation for injury rehabilitation can have negative impacts on health outcomes. This study examined transport injury compensation policy in the Australian state of Victoria to: determine type and purpose of reference to information sources; and to identify the extent of reference to academic research evidence in transport related injury rehabilitation compensation policy.

Methods

Quantitative content analysis of injury rehabilitation compensation policies (N = 128) from the Victorian state government transport accident compensation authority.

Results

The most commonly referenced types of information were Internal Policy (median = 6 references per policy), Clinical/Medical (2.5), and Internal Legislation (1). Academic Research Evidence was the least often referenced source of information. The main purpose of reference to information was to support injury treatment and rehabilitation compensation claims decision-making.

Conclusions

Transport injury compensation policy development is complex; with multiple sources of information cited including legislation, internal policy, external policy and clinical/medical evidence. There is limited use of academic research evidence in Victorian state government injury treatment and rehabilitation compensation policies. Decisions regarding compensation for injury treatment and rehabilitation services could benefit from greater use of academic research evidence. This study is one of the first to examine the use of research evidence in existing Australian public health policy decision-making using rigorous quantitative methods. It provides a practical example of how use of research evidence in public health policy can be objectively measured.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hanney SR, Gonzalez-Block MA, Buxton MJ, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1 (2): Hanney SR, Gonzalez-Block MA, Buxton MJ, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1 (2):
2.
go back to reference Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28 (5 Suppl): 226-230.CrossRefPubMed Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28 (5 Suppl): 226-230.CrossRefPubMed
3.
go back to reference Head B: Evidence-Based Policy: Principles and Requirements. Strengthening Evidence-based Policy in the Australian Federation: Roundtable Proceeding Volume 4. Edited by: Productivity Commission. 2010, Canberra: Commonwealth of Australia Head B: Evidence-Based Policy: Principles and Requirements. Strengthening Evidence-based Policy in the Australian Federation: Roundtable Proceeding Volume 4. Edited by: Productivity Commission. 2010, Canberra: Commonwealth of Australia
4.
go back to reference Armstrong R, Waters E, Crockett B, Keleher H: The nature of evidence resources and knowledge translation for health promotion practitioners. Health Promot Int. 2007, 22 (3): 254-260. 10.1093/heapro/dam017.CrossRefPubMed Armstrong R, Waters E, Crockett B, Keleher H: The nature of evidence resources and knowledge translation for health promotion practitioners. Health Promot Int. 2007, 22 (3): 254-260. 10.1093/heapro/dam017.CrossRefPubMed
5.
go back to reference Orton L, Lloyd-Williams F, Taylor-Robinson D, O’Flaherty M, Capewell S: The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6 (7): Orton L, Lloyd-Williams F, Taylor-Robinson D, O’Flaherty M, Capewell S: The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6 (7):
6.
go back to reference Campbell DM, Redman S, Jorm L, Cooke M, Zwi AB, Rychetnik L: Increasing the use of evidence in health policy: practice and views of policy makers and researchers. Aust New Zealand Health Policy. 2009, 6 (21): Campbell DM, Redman S, Jorm L, Cooke M, Zwi AB, Rychetnik L: Increasing the use of evidence in health policy: practice and views of policy makers and researchers. Aust New Zealand Health Policy. 2009, 6 (21):
7.
go back to reference Ritter A: How do drug policy makers access research evidence?. Int J Drug Policy. 2009, 20 (1): 70-75. 10.1016/j.drugpo.2007.11.017.CrossRefPubMed Ritter A: How do drug policy makers access research evidence?. Int J Drug Policy. 2009, 20 (1): 70-75. 10.1016/j.drugpo.2007.11.017.CrossRefPubMed
8.
go back to reference Flitcroft K, Gillespie J, Salkeld G, Carter S, Trevena L: Getting evidence into policy: the need for deliberative strategies?. Soc Sci Med. 2011, 72 (7): 1039-1046. 10.1016/j.socscimed.2011.01.034.CrossRefPubMed Flitcroft K, Gillespie J, Salkeld G, Carter S, Trevena L: Getting evidence into policy: the need for deliberative strategies?. Soc Sci Med. 2011, 72 (7): 1039-1046. 10.1016/j.socscimed.2011.01.034.CrossRefPubMed
9.
go back to reference Greenhalgh T, Robert G, Macfarlance F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. Millbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRef Greenhalgh T, Robert G, Macfarlance F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. Millbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRef
10.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral
11.
go back to reference Best A, Terpstra JL, Moor G, Riley B, Norman CD, Glasgow RE: Building knowledge integration systems for evidence-informed decisions. J Health Organ Manag. 2009, 23 (6): Best A, Terpstra JL, Moor G, Riley B, Norman CD, Glasgow RE: Building knowledge integration systems for evidence-informed decisions. J Health Organ Manag. 2009, 23 (6):
12.
go back to reference Straus SE, Tetroe J, Graham ID, Zwarenstein M, Bhattacharyya O, Shepperd S: Monitoring use of knowledge and evaluating outcomes. Can Med Assoc J. 2010, 182 (2): E94-E98. 10.1503/cmaj.081335.CrossRef Straus SE, Tetroe J, Graham ID, Zwarenstein M, Bhattacharyya O, Shepperd S: Monitoring use of knowledge and evaluating outcomes. Can Med Assoc J. 2010, 182 (2): E94-E98. 10.1503/cmaj.081335.CrossRef
13.
go back to reference Gabbe B, Slenley J, Gosling CM, Wilson K, Sutherland A, Hart M, Watterson D, Christie N: Financial and employment impacts of serious injury: a qualitative study. Injury. 2014 Gabbe B, Slenley J, Gosling CM, Wilson K, Sutherland A, Hart M, Watterson D, Christie N: Financial and employment impacts of serious injury: a qualitative study. Injury. 2014
14.
go back to reference Kendrick D, Vinogradova Y, Coupland C, Christie N, Lyons R, Towner E: Getting back to work after injury: the UK burden of injury multicentre longitudinal study. BMC Public Health. 2012, 12: Kendrick D, Vinogradova Y, Coupland C, Christie N, Lyons R, Towner E: Getting back to work after injury: the UK burden of injury multicentre longitudinal study. BMC Public Health. 2012, 12:
15.
go back to reference Personal Injury Education Foundation: Understanding Accident Compensation in Australia and New Zealand. 2011, PIEF: Melbourne Personal Injury Education Foundation: Understanding Accident Compensation in Australia and New Zealand. 2011, PIEF: Melbourne
16.
go back to reference The Commonwealth Fund: International Profile of Health Care Systems, 2013. 2013, Australia, Canada, Denmark, England, France, Germany, Italy, Japan, The Netherlands, New Zealand, Norway, Sweden, Switzerland, and the United States: Commonwealth Fund The Commonwealth Fund: International Profile of Health Care Systems, 2013. 2013, Australia, Canada, Denmark, England, France, Germany, Italy, Japan, The Netherlands, New Zealand, Norway, Sweden, Switzerland, and the United States: Commonwealth Fund
19.
go back to reference Medical Benefits Reviews Task Group: MBS Quality Framework Discussion Paper. Department of Health and Ageing. 2010, Canberra: Commonwealth Government Medical Benefits Reviews Task Group: MBS Quality Framework Discussion Paper. Department of Health and Ageing. 2010, Canberra: Commonwealth Government
20.
go back to reference Gabbe BJ, Cameron PA, Williamson OD, Edwards ER: The relationship between compensable status and long-term patient outcomes following orthopaedic trauma. Med J Aust. 2007, 187 (1): Gabbe BJ, Cameron PA, Williamson OD, Edwards ER: The relationship between compensable status and long-term patient outcomes following orthopaedic trauma. Med J Aust. 2007, 187 (1):
21.
go back to reference Harris I, Mulford J, Solomon M, van Gelder JM, Young J: Association between compensation status and outcome after surgery. JAMA. 2005, 293 (13): 1644-1652. 10.1001/jama.293.13.1644.CrossRefPubMed Harris I, Mulford J, Solomon M, van Gelder JM, Young J: Association between compensation status and outcome after surgery. JAMA. 2005, 293 (13): 1644-1652. 10.1001/jama.293.13.1644.CrossRefPubMed
22.
go back to reference Rohling ML, Binder L, Langhinrichsen-Rohling J: Money matters: a meta-analytic review of the association between financial compensation and the experience and treatment of chronic pain. Health Psychol. 1995, 14 (6): Rohling ML, Binder L, Langhinrichsen-Rohling J: Money matters: a meta-analytic review of the association between financial compensation and the experience and treatment of chronic pain. Health Psychol. 1995, 14 (6):
23.
go back to reference The Australasian Faculty of Occupational Medicine: Compensable Injuries and Health Outcome. 2001, Sydney: The Royal Australasian College of Physicians The Australasian Faculty of Occupational Medicine: Compensable Injuries and Health Outcome. 2001, Sydney: The Royal Australasian College of Physicians
24.
go back to reference Alban RF, Berry C, Ley E, Mirocha J, Margulies DR, Tillou A, Salim A: Does health care insurance affect outcomes after traumatic brain injury? Analysis of the National Trauma Databank. Am Surg. 2010, 76 (10): Alban RF, Berry C, Ley E, Mirocha J, Margulies DR, Tillou A, Salim A: Does health care insurance affect outcomes after traumatic brain injury? Analysis of the National Trauma Databank. Am Surg. 2010, 76 (10):
25.
go back to reference Lilley R, Davie G, Ameratunga S, Derrett S: Factors predicting work status 3 months after injury: results from the prospective outcomes of injury study. BMJ Open. 2012, 2: Lilley R, Davie G, Ameratunga S, Derrett S: Factors predicting work status 3 months after injury: results from the prospective outcomes of injury study. BMJ Open. 2012, 2:
26.
go back to reference Cameron ID, Rebbeck T, Sindhusake D, Rubin G, Feyer AM, Walsh J, Schofield WN: Legislative change is associated with improved health status in people with whiplash. Spine. 2008, 33 (3): Cameron ID, Rebbeck T, Sindhusake D, Rubin G, Feyer AM, Walsh J, Schofield WN: Legislative change is associated with improved health status in people with whiplash. Spine. 2008, 33 (3):
27.
go back to reference Grant G, Studdert DM: Poisoned chalice? A critical analysis of the evidence linking personal injury compensation processes with adverse health outcomes. Melbourne Univ Law Rev. 2009, 33 (3): Grant G, Studdert DM: Poisoned chalice? A critical analysis of the evidence linking personal injury compensation processes with adverse health outcomes. Melbourne Univ Law Rev. 2009, 33 (3):
28.
go back to reference Brownson RC, Fielding JE, Maylahn CM: Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009, 30 (1): 175-201. 10.1146/annurev.publhealth.031308.100134.CrossRefPubMed Brownson RC, Fielding JE, Maylahn CM: Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009, 30 (1): 175-201. 10.1146/annurev.publhealth.031308.100134.CrossRefPubMed
29.
go back to reference Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.CrossRefPubMed Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.CrossRefPubMed
30.
go back to reference Task Force: Scaling up Research and Learning for Health Systems: now is the Time. Global Ministerial Forum on Research for Health 2008. 2009, Bamako: WHO Press Task Force: Scaling up Research and Learning for Health Systems: now is the Time. Global Ministerial Forum on Research for Health 2008. 2009, Bamako: WHO Press
32.
go back to reference Australian Transport Council: National Road Safety Strategy 2011–2020. Infrastructure and Transport. 2011, Canberra: Commonwealth Government Australian Transport Council: National Road Safety Strategy 2011–2020. Infrastructure and Transport. 2011, Canberra: Commonwealth Government
33.
go back to reference Transport Accident Commission: Here for Our Clients: Annual Report 2011. Transport Accident Commission. 2011, Geelong: State Government Victoria Transport Accident Commission: Here for Our Clients: Annual Report 2011. Transport Accident Commission. 2011, Geelong: State Government Victoria
34.
go back to reference Ruseckaite R, Gabbe B, Vogel AP, Collie A: Health care utilisation following hospitalisation for transport-related injury. Injury. 2012, 104 (2): 155-162. Ruseckaite R, Gabbe B, Vogel AP, Collie A: Health care utilisation following hospitalisation for transport-related injury. Injury. 2012, 104 (2): 155-162.
35.
go back to reference Bryman A: Social Research Methods. 2008, Oxford: Oxford University Press Bryman A: Social Research Methods. 2008, Oxford: Oxford University Press
36.
go back to reference Sproule W: Social Research Methods: An Australian Perspective. M. Walter. 2006, South Melbourne: Oxford University Press Sproule W: Social Research Methods: An Australian Perspective. M. Walter. 2006, South Melbourne: Oxford University Press
38.
go back to reference Mitton C, Adair CE, McKenzie E, Patten SB, Waye Perry B: Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007, 85 (4): 729-768. 10.1111/j.1468-0009.2007.00506.x. Epub 2007/12/12CrossRefPubMedPubMedCentral Mitton C, Adair CE, McKenzie E, Patten SB, Waye Perry B: Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007, 85 (4): 729-768. 10.1111/j.1468-0009.2007.00506.x. Epub 2007/12/12CrossRefPubMedPubMedCentral
39.
go back to reference Frieberg A, Carson WA: Limits to evidence-based policy: evidence, emotion and criminal justice. Aust J Public Admin. 2010, 69 (2): 152-164. 10.1111/j.1467-8500.2010.00674.x.CrossRef Frieberg A, Carson WA: Limits to evidence-based policy: evidence, emotion and criminal justice. Aust J Public Admin. 2010, 69 (2): 152-164. 10.1111/j.1467-8500.2010.00674.x.CrossRef
40.
go back to reference Killoran A, Kelly MP: Evidence-Based Public Health: Effectiveness and Efficiency. 2010, Oxford; New York: Oxford University Press Killoran A, Kelly MP: Evidence-Based Public Health: Effectiveness and Efficiency. 2010, Oxford; New York: Oxford University Press
41.
go back to reference Althaus C, Bridgman P, Davis G: The Australian Policy Handbook. Crows Nest. 2007, N.S.W: Allen & Unwin, 4 Althaus C, Bridgman P, Davis G: The Australian Policy Handbook. Crows Nest. 2007, N.S.W: Allen & Unwin, 4
42.
43.
go back to reference Banks G: Challenges of Evidence-Based Policy-Making. Commission APS. 2009, Canberra: Commonweath of Australia Banks G: Challenges of Evidence-Based Policy-Making. Commission APS. 2009, Canberra: Commonweath of Australia
44.
go back to reference Greenhalgh T: How to Read a Paper: The Basics of Evidence Based Medicine. 2010, Hoboken: Wiley-Blackwell Greenhalgh T: How to Read a Paper: The Basics of Evidence Based Medicine. 2010, Hoboken: Wiley-Blackwell
45.
go back to reference Kavanagh A, Daley J, Melder A, Jolley D: ‘Mind the Gap’: Assesing the Quality of Evidence for Public Health Problems. Evidence-Based Health Policy: Problems and Possibilities. Edited by: Lin V, Gibson B. 2003, South Melbourne: Oxford University Press Kavanagh A, Daley J, Melder A, Jolley D: ‘Mind the Gap’: Assesing the Quality of Evidence for Public Health Problems. Evidence-Based Health Policy: Problems and Possibilities. Edited by: Lin V, Gibson B. 2003, South Melbourne: Oxford University Press
46.
go back to reference Lin V, Gibson B: Evidence-Based Health Policy: Problems & Possibilities. 2003, South Melbourne, Vic: New York, Oxford University Press Lin V, Gibson B: Evidence-Based Health Policy: Problems & Possibilities. 2003, South Melbourne, Vic: New York, Oxford University Press
47.
go back to reference McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348 (26): 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348 (26): 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed
50.
go back to reference Lavis J: How can we support the use of systematic reviews in policymaking?. PLoS Med. 2009, 6 (11): Lavis J: How can we support the use of systematic reviews in policymaking?. PLoS Med. 2009, 6 (11):
51.
go back to reference Law C: Policy and Evidence-Based Public Health. Evidence-based public health: effectiveness and efficiency. Edited by: Killoran A, Kelly MP. 2010, New York: Oxford University Press, p. xxvii, 499 Law C: Policy and Evidence-Based Public Health. Evidence-based public health: effectiveness and efficiency. Edited by: Killoran A, Kelly MP. 2010, New York: Oxford University Press, p. xxvii, 499
52.
go back to reference Best A, Holmes B: Systems thinking, knowledge and action: towards better models and methods. Evid Policy J Res Debate Pract. 2010, 6 (2): 145-159. 10.1332/174426410X502284.CrossRef Best A, Holmes B: Systems thinking, knowledge and action: towards better models and methods. Evid Policy J Res Debate Pract. 2010, 6 (2): 145-159. 10.1332/174426410X502284.CrossRef
54.
go back to reference Lewis JM: Health Policy and Politics: Networks, Ideas and Power. 2005, East Hawthorn: IP Communications Lewis JM: Health Policy and Politics: Networks, Ideas and Power. 2005, East Hawthorn: IP Communications
55.
go back to reference Van Eerd D, Cole D, Kohn MK, Mahood Q, Slack T, Amick BC, Phipps D, Garcia J, Morassaei S: Report on Knowledge Transfer and Exchange Practices: A Systematic Review of the Quality and Types of Instruments Used to Assess KTE Implementation and Impact. 2011, Toronto: Institute for Work & Health Van Eerd D, Cole D, Kohn MK, Mahood Q, Slack T, Amick BC, Phipps D, Garcia J, Morassaei S: Report on Knowledge Transfer and Exchange Practices: A Systematic Review of the Quality and Types of Instruments Used to Assess KTE Implementation and Impact. 2011, Toronto: Institute for Work & Health
56.
go back to reference Perrier L, Mrklas K, Lavis JN, Straus SE: Interventions encouraging the use of systematic reviews by health policymakers and managers: a systematic review. Implement Sci. 2011, 6 (1): Perrier L, Mrklas K, Lavis JN, Straus SE: Interventions encouraging the use of systematic reviews by health policymakers and managers: a systematic review. Implement Sci. 2011, 6 (1):
Metadata
Title
Measuring use of research evidence in public health policy: a policy content analysis
Authors
Pauline Zardo
Alex Collie
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2014
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-14-496

Other articles of this Issue 1/2014

BMC Public Health 1/2014 Go to the issue