Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Predicting research use in a public health policy environment: results of a logistic regression analysis

Authors: Pauline Zardo, Alex Collie

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Use of research evidence in public health policy decision-making is affected by a range of contextual factors operating at the individual, organisational and external levels. Context-specific research is needed to target and tailor research translation intervention design and implementation to ensure that factors affecting research in a specific context are addressed. Whilst such research is increasing, there remain relatively few studies that have quantitatively assessed the factors that predict research use in specific public health policy environments.

Method

A quantitative survey was designed and implemented within two public health policy agencies in the Australian state of Victoria. Binary logistic regression analyses were conducted on survey data provided by 372 participants. Univariate logistic regression analyses of 49 factors revealed 26 factors that significantly predicted research use independently. The 26 factors were then tested in a single model and five factors emerged as significant predictors of research over and above all other factors.

Results

The five key factors that significantly predicted research use were the following: relevance of research to day-to-day decision-making, skills for research use, internal prompts for use of research, intention to use research within the next 12 months and the agency for which the individual worked.

Conclusions

These findings suggest that individual- and organisational-level factors are the critical factors to target in the design of interventions aiming to increase research use in this context. In particular, relevance of research and skills for research use would be necessary to target. The likelihood for research use increased 11- and 4-fold for those who rated highly on these factors. This study builds on previous research and contributes to the currently limited number of quantitative studies that examine use of research evidence in a large sample of public health policy and program decision-makers within a specific context. The survey used in this study is likely to be relevant for use in other public health policy contexts.
Appendix
Available only for authorised users
Literature
1.
go back to reference Moore G, Redman S, Haines M, Todd A: What works to increase the use of research in population health policy and programmes: a review. Evid Pol. 2011, 7 (3): 277-305. 10.1332/174426411X579199.CrossRef Moore G, Redman S, Haines M, Todd A: What works to increase the use of research in population health policy and programmes: a review. Evid Pol. 2011, 7 (3): 277-305. 10.1332/174426411X579199.CrossRef
2.
go back to reference Davies P: The state of evidence-based policy evaluation and its role in policy formation. National Institute Economic Review. 2012, 219 (1): R41-R52. 10.1177/002795011221900105.CrossRef Davies P: The state of evidence-based policy evaluation and its role in policy formation. National Institute Economic Review. 2012, 219 (1): R41-R52. 10.1177/002795011221900105.CrossRef
3.
go back to reference National Health and Medical Research Council: Research Translation Faculty. 2013. Available from: http://www.nhmrc.gov.au/research-translation/research-translation-faculty. National Health and Medical Research Council: Research Translation Faculty. 2013. Available from: http://​www.​nhmrc.​gov.​au/​research-translation/​research-translation-faculty.​
4.
go back to reference Rymer L: Measuring The Impact Of Research—The Context For Metric Development. 2011, The Group of Eight, Canberra Rymer L: Measuring The Impact Of Research—The Context For Metric Development. 2011, The Group of Eight, Canberra
5.
go back to reference Lavis J, Ross S, McLeod C, Gildiner A: Measuring the impact of health research. J Health Serv Res Policy. 2003, 8 (3): 165-170. 10.1258/135581903322029520.CrossRefPubMed Lavis J, Ross S, McLeod C, Gildiner A: Measuring the impact of health research. J Health Serv Res Policy. 2003, 8 (3): 165-170. 10.1258/135581903322029520.CrossRefPubMed
6.
go back to reference Orton L, Lloyd-Williams F, Taylor-Robinson D, O'Flaherty M, Capewell S: The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6 (7): e21704-10.1371/journal.pone.0021704.CrossRefPubMedPubMedCentral Orton L, Lloyd-Williams F, Taylor-Robinson D, O'Flaherty M, Capewell S: The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6 (7): e21704-10.1371/journal.pone.0021704.CrossRefPubMedPubMedCentral
7.
8.
go back to reference Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.CrossRefPubMed Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.CrossRefPubMed
9.
go back to reference Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist review—a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005, 10: 21-34. 10.1258/1355819054308530.CrossRefPubMed Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist review—a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005, 10: 21-34. 10.1258/1355819054308530.CrossRefPubMed
10.
go back to reference Greenhalgh , Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. Millbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRef Greenhalgh , Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. Millbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRef
11.
12.
go back to reference Lavis JN, Røttingen JA, Bosch-Capblanch X, Atun R, El-Jardali F, Gilson L, Lewin S, Oliver S, Ongolo-Zogo P, Haines A: Guidance for evidence-informed policies about health systems: linking guidance development to policy development. PLoS Med. 2012, 9 (3): e1001186-10.1371/journal.pmed.1001186.CrossRefPubMedPubMedCentral Lavis JN, Røttingen JA, Bosch-Capblanch X, Atun R, El-Jardali F, Gilson L, Lewin S, Oliver S, Ongolo-Zogo P, Haines A: Guidance for evidence-informed policies about health systems: linking guidance development to policy development. PLoS Med. 2012, 9 (3): e1001186-10.1371/journal.pmed.1001186.CrossRefPubMedPubMedCentral
13.
go back to reference Rycroft-Malone J, Seers K, Chandler J, Hawkes C, Crichton N, Allen C, Bullock I, Strunin L: The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013, 8 (1): 28-10.1186/1748-5908-8-28.CrossRefPubMedPubMedCentral Rycroft-Malone J, Seers K, Chandler J, Hawkes C, Crichton N, Allen C, Bullock I, Strunin L: The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013, 8 (1): 28-10.1186/1748-5908-8-28.CrossRefPubMedPubMedCentral
14.
go back to reference Chagnon F, Pouliot L, Malo C, Gervais M-J, Pigeon M-E: Comparison of determinants of research knowledge utilization by practitioners and administrators in the field of child and family social services. Implement Sci. 2010, 5 (1): 41-10.1186/1748-5908-5-41.CrossRefPubMedPubMedCentral Chagnon F, Pouliot L, Malo C, Gervais M-J, Pigeon M-E: Comparison of determinants of research knowledge utilization by practitioners and administrators in the field of child and family social services. Implement Sci. 2010, 5 (1): 41-10.1186/1748-5908-5-41.CrossRefPubMedPubMedCentral
15.
go back to reference Stetler CB, Ritchie JA, Rycroft-Malone J, Schultz AA, Charns MP: Institutionalizing evidence-based practice: an organizational case study using a model of strategic change. Implement Sci. 2009, 4 (1): 78-10.1186/1748-5908-4-78.CrossRefPubMedPubMedCentral Stetler CB, Ritchie JA, Rycroft-Malone J, Schultz AA, Charns MP: Institutionalizing evidence-based practice: an organizational case study using a model of strategic change. Implement Sci. 2009, 4 (1): 78-10.1186/1748-5908-4-78.CrossRefPubMedPubMedCentral
16.
go back to reference Head B, Ferguson M, Cherney A, Boreham P: Are policy-makers interested in social research? Exploring the sources and uses of valued information among public servants in Australia. Pol Soc. 2014, 33 (2): 89-101. 10.1016/j.polsoc.2014.04.004.CrossRef Head B, Ferguson M, Cherney A, Boreham P: Are policy-makers interested in social research? Exploring the sources and uses of valued information among public servants in Australia. Pol Soc. 2014, 33 (2): 89-101. 10.1016/j.polsoc.2014.04.004.CrossRef
17.
go back to reference Australian Bureau of Statistics: Australian Demographic Statistics. Canberra: Commonwealth Government; 2012. Report No. Australian Bureau of Statistics: Australian Demographic Statistics. Canberra: Commonwealth Government; 2012. Report No.
18.
go back to reference Kothari A, Edwards N, Hamel N, Judd M: Is research working for you? validating a tool to examine the capacity of health organizations to use research.Implementation Science 2009, 4(46): doi:10.1186/1748-5908-4-46., Kothari A, Edwards N, Hamel N, Judd M: Is research working for you? validating a tool to examine the capacity of health organizations to use research.Implementation Science 2009, 4(46): doi:10.1186/1748-5908-4-46.,
19.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14: 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral
20.
go back to reference Campbell DM, Redman S, Jorm L, Cooke M, Zwi AB, Rychetnik L: Increasing the use of evidence in health policy: practice and views of policy makers and researchers.Aust New Zealand Health Policy 2009, 6(21)., Campbell DM, Redman S, Jorm L, Cooke M, Zwi AB, Rychetnik L: Increasing the use of evidence in health policy: practice and views of policy makers and researchers.Aust New Zealand Health Policy 2009, 6(21).,
21.
go back to reference Amara N, Ouimet M, Landry R: New evidence on instrumental, conceptual, and symbolic utilization of university research in government agencies. Sci Comm. 2004, 26 (1): 75-106. 10.1177/1075547004267491.CrossRef Amara N, Ouimet M, Landry R: New evidence on instrumental, conceptual, and symbolic utilization of university research in government agencies. Sci Comm. 2004, 26 (1): 75-106. 10.1177/1075547004267491.CrossRef
22.
go back to reference Mitton C, Adair CE, McKenzie E, Patten SB, Waye PB: Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007, 85 (4): 729-768. 10.1111/j.1468-0009.2007.00506.x. Epub 2007/12/12CrossRefPubMedPubMedCentral Mitton C, Adair CE, McKenzie E, Patten SB, Waye PB: Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007, 85 (4): 729-768. 10.1111/j.1468-0009.2007.00506.x. Epub 2007/12/12CrossRefPubMedPubMedCentral
23.
go back to reference Streiner D: Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003, 80 (1): 99-103. 10.1207/S15327752JPA8001_18.CrossRefPubMed Streiner D: Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003, 80 (1): 99-103. 10.1207/S15327752JPA8001_18.CrossRefPubMed
24.
go back to reference DeVellis RF: Scale Development Theory and Applications. 2012, Sage, Thousand Oaks DeVellis RF: Scale Development Theory and Applications. 2012, Sage, Thousand Oaks
25.
go back to reference Hosmer D, Lemeshow S: Applied Logistic Regression Second Edition. 2000, John Wiley and Sons, Hoboken, N.J.CrossRef Hosmer D, Lemeshow S: Applied Logistic Regression Second Edition. 2000, John Wiley and Sons, Hoboken, N.J.CrossRef
26.
go back to reference Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J: A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014, 14 (1): 2-10.1186/1472-6963-14-2.CrossRefPubMedPubMedCentral Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J: A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014, 14 (1): 2-10.1186/1472-6963-14-2.CrossRefPubMedPubMedCentral
27.
go back to reference Haynes AS, Derrick GE, Chapman S, Redman S, Hall WD, Gillespie J, Sturk H: From "our world" to the "real world": exploring the views and behaviour of policy-influential Australian public health researchers. Soc Sci Med. 2011, 72 (7): 1047-1055. 10.1016/j.socscimed.2011.02.004.CrossRefPubMed Haynes AS, Derrick GE, Chapman S, Redman S, Hall WD, Gillespie J, Sturk H: From "our world" to the "real world": exploring the views and behaviour of policy-influential Australian public health researchers. Soc Sci Med. 2011, 72 (7): 1047-1055. 10.1016/j.socscimed.2011.02.004.CrossRefPubMed
28.
go back to reference Haynes AS, Gillespie JA, Derrick GE, Hall WD, Redman S, Chapman S, Sturk H: Galvanizers, guides, champions, and shields: the many ways that policymakers use public health researchers. Milbank Q. 2011, 89 (4): 564-598. 10.1111/j.1468-0009.2011.00643.x.CrossRefPubMedPubMedCentral Haynes AS, Gillespie JA, Derrick GE, Hall WD, Redman S, Chapman S, Sturk H: Galvanizers, guides, champions, and shields: the many ways that policymakers use public health researchers. Milbank Q. 2011, 89 (4): 564-598. 10.1111/j.1468-0009.2011.00643.x.CrossRefPubMedPubMedCentral
29.
go back to reference Cherney A, Head B, Boreham P, Povey J, Ferguson M: Perspectives of academic social scientists on knowledge transfer and research collaborations: a cross-sectional survey of Australian academics. Evid Pol. 2012, 8 (4): 433-453. 10.1332/174426412X660098.CrossRef Cherney A, Head B, Boreham P, Povey J, Ferguson M: Perspectives of academic social scientists on knowledge transfer and research collaborations: a cross-sectional survey of Australian academics. Evid Pol. 2012, 8 (4): 433-453. 10.1332/174426412X660098.CrossRef
30.
go back to reference Shine KT, Bartley B: Whose evidence base? The dynamic effects of ownership, receptivity and values on collaborative evidence-informed policy making. Evid Pol. 2011, 7 (4): 511-530. 10.1332/174426411X603489.CrossRef Shine KT, Bartley B: Whose evidence base? The dynamic effects of ownership, receptivity and values on collaborative evidence-informed policy making. Evid Pol. 2011, 7 (4): 511-530. 10.1332/174426411X603489.CrossRef
31.
go back to reference Banks G: Challenges of Evidence-Based Policy-Making. Edited by Commission APS. 2009, Commonweath of Australia, Canberra Banks G: Challenges of Evidence-Based Policy-Making. Edited by Commission APS. 2009, Commonweath of Australia, Canberra
32.
go back to reference Lomas J: Master Class: Diffusion, Spread and Sustainability of Innovation Australian Primary Health Care Research Institute Lecture Series. Australian National University; 2011. Lomas J: Master Class: Diffusion, Spread and Sustainability of Innovation Australian Primary Health Care Research Institute Lecture Series. Australian National University; 2011.
33.
go back to reference Ritter A: How do drug policy makers access research evidence?. Int J Drug Policy. 2009, 20 (1): 70-75. 10.1016/j.drugpo.2007.11.017.CrossRefPubMed Ritter A: How do drug policy makers access research evidence?. Int J Drug Policy. 2009, 20 (1): 70-75. 10.1016/j.drugpo.2007.11.017.CrossRefPubMed
34.
go back to reference Flitcroft K, Gillespie J, Salkeld G, Carter S, Trevena L: Getting evidence into policy: the need for deliberative strategies?. Soc Sci Med. 2011, 72 (7): 1039-1046. 10.1016/j.socscimed.2011.01.034.CrossRefPubMed Flitcroft K, Gillespie J, Salkeld G, Carter S, Trevena L: Getting evidence into policy: the need for deliberative strategies?. Soc Sci Med. 2011, 72 (7): 1039-1046. 10.1016/j.socscimed.2011.01.034.CrossRefPubMed
35.
go back to reference Ouimet M, Bédard PO, Turgeon J, Lavis JN, Gélineau F, Gagnon F, Dallaire C: Correlates of consulting research evidence among policy analysts in government ministries: a cross-sectional survey. Evid Pol. 2010, 6 (4): 433-460. 10.1332/174426410X535846.CrossRef Ouimet M, Bédard PO, Turgeon J, Lavis JN, Gélineau F, Gagnon F, Dallaire C: Correlates of consulting research evidence among policy analysts in government ministries: a cross-sectional survey. Evid Pol. 2010, 6 (4): 433-460. 10.1332/174426410X535846.CrossRef
36.
go back to reference Ellen ME, Lavis JN, Ouimet M, Grimshaw J, Bédard P-O: Determining research knowledge infrastructure for healthcare systems: a qualitative study. Implement Sci. 2011, 6 (1): 60-10.1186/1748-5908-6-60.CrossRefPubMedPubMedCentral Ellen ME, Lavis JN, Ouimet M, Grimshaw J, Bédard P-O: Determining research knowledge infrastructure for healthcare systems: a qualitative study. Implement Sci. 2011, 6 (1): 60-10.1186/1748-5908-6-60.CrossRefPubMedPubMedCentral
37.
go back to reference Lavis JN, Lomas J, Hamid M, Sewankambo NK: Assessing country-level efforts to link research to action. Bull World Health Organ. 2006, 84 (8): 620-628. 10.2471/BLT.06.030312. Epub 2006/08/19CrossRefPubMedPubMedCentral Lavis JN, Lomas J, Hamid M, Sewankambo NK: Assessing country-level efforts to link research to action. Bull World Health Organ. 2006, 84 (8): 620-628. 10.2471/BLT.06.030312. Epub 2006/08/19CrossRefPubMedPubMedCentral
39.
go back to reference Landry R, Lamari M, Amara N: The extent and determinants of the utilization of university research in government agencies. Public Adm Rev. 2003, 63 (2): 192-205. 10.1111/1540-6210.00279.CrossRef Landry R, Lamari M, Amara N: The extent and determinants of the utilization of university research in government agencies. Public Adm Rev. 2003, 63 (2): 192-205. 10.1111/1540-6210.00279.CrossRef
40.
go back to reference Innvær S, Vist G, Trommald M, Oxman A: Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7 (4): 239-244. 10.1258/135581902320432778.CrossRefPubMed Innvær S, Vist G, Trommald M, Oxman A: Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7 (4): 239-244. 10.1258/135581902320432778.CrossRefPubMed
41.
go back to reference Weiss CH, Bucuvalas MJ: Truth tests and utility tests: decision-makers' frames of reference for social science research. Am Sociol Rev. 1980, 45 (2): 302-313. 10.2307/2095127.CrossRef Weiss CH, Bucuvalas MJ: Truth tests and utility tests: decision-makers' frames of reference for social science research. Am Sociol Rev. 1980, 45 (2): 302-313. 10.2307/2095127.CrossRef
42.
go back to reference Weiss JA, Weiss CH: Social scientists and decision makers look at the usefulness of mental health research. Am Psychol. 1981, 36 (8): 837-847. 10.1037/0003-066X.36.8.837.CrossRefPubMed Weiss JA, Weiss CH: Social scientists and decision makers look at the usefulness of mental health research. Am Psychol. 1981, 36 (8): 837-847. 10.1037/0003-066X.36.8.837.CrossRefPubMed
43.
go back to reference Kingdon JW: Agendas, Alternatives, and Public Policies. 1995, HarperCollins College Publishers, New York Kingdon JW: Agendas, Alternatives, and Public Policies. 1995, HarperCollins College Publishers, New York
44.
go back to reference Weiss CH: The many meanings of research utilization. Public Adm Rev. 1979, 39 (5): 426-431. 10.2307/3109916.CrossRef Weiss CH: The many meanings of research utilization. Public Adm Rev. 1979, 39 (5): 426-431. 10.2307/3109916.CrossRef
45.
go back to reference Taylor RS, Reeves BC, Ewings PE, Taylor RJ: Critical appraisal skills training for health care professionals: a randomized controlled trial [ISRCTN46272378]. BMC Med Educ. 2004, 4 (1): 30-10.1186/1472-6920-4-30.CrossRefPubMedPubMedCentral Taylor RS, Reeves BC, Ewings PE, Taylor RJ: Critical appraisal skills training for health care professionals: a randomized controlled trial [ISRCTN46272378]. BMC Med Educ. 2004, 4 (1): 30-10.1186/1472-6920-4-30.CrossRefPubMedPubMedCentral
46.
go back to reference Denis J-L, Lomas J, Stipich N: Creating receptor capacity for research in the health system: the Executive Training for Research Application (EXTRA) program in Canada. J Health Serv Res Policy. 2008, 13 (Suppl 1): 1-7. 10.1258/jhsrp.2007.007123.CrossRefPubMed Denis J-L, Lomas J, Stipich N: Creating receptor capacity for research in the health system: the Executive Training for Research Application (EXTRA) program in Canada. J Health Serv Res Policy. 2008, 13 (Suppl 1): 1-7. 10.1258/jhsrp.2007.007123.CrossRefPubMed
47.
go back to reference Azjen I, Czasch C: From intentions to behavior: implementation intention, commitment, and conscientiousness. J Appl Psychol. 2009, 39 (6): 1356-1372. Azjen I, Czasch C: From intentions to behavior: implementation intention, commitment, and conscientiousness. J Appl Psychol. 2009, 39 (6): 1356-1372.
48.
go back to reference Maio GR, Haddock G: Contemporary Perspectives on The Psychology of Attitudes, Volume xviii. Hove, U.K.; New York: Psychology Press; 2004:469. Maio GR, Haddock G: Contemporary Perspectives on The Psychology of Attitudes, Volume xviii. Hove, U.K.; New York: Psychology Press; 2004:469.
49.
go back to reference Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL, O'Mara L, DeCorby K, Robeson P: A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies.Implement Sci 2009, 61(4)., Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL, O'Mara L, DeCorby K, Robeson P: A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies.Implement Sci 2009, 61(4).,
50.
go back to reference Australasian Cochrane Centre: Centre for Informing Policy in Health with Evidence from Research. 2013. Available from: http://acc.cochrane.org/cipher Australasian Cochrane Centre: Centre for Informing Policy in Health with Evidence from Research. 2013. Available from: http://​acc.​cochrane.​org/​cipher
Metadata
Title
Predicting research use in a public health policy environment: results of a logistic regression analysis
Authors
Pauline Zardo
Alex Collie
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-014-0142-8

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue