Skip to main content
Top
Published in: Systematic Reviews 1/2016

Open Access 01-12-2016 | Protocol

What factors affect evidence-informed policymaking in public health? Protocol for a systematic review of qualitative evidence using thematic synthesis

Authors: Ben Verboom, Paul Montgomery, Sara Bennett

Published in: Systematic Reviews | Issue 1/2016

Login to get access

Abstract

Background

Claims of and calls for evidence-informed policymaking pervade public health journals and the literature of governments and global health agencies, yet our knowledge of the arrangements most conducive to the appropriate use of evidence is incomplete and fragmented. Designing interventions to encourage evidence use by policymakers requires an understanding of the processes through which officials access, assess and use research, including technical and political factors related to evidence uptake, and the ways in which the policymaking context can affect these processes. This review aims to systematically locate, synthesise and interpret the existing qualitative work on the process of evidence use in public health policymaking, with the aim of producing an empirically derived taxonomy of factors affecting evidence use.

Methods/design

This review will include primary qualitative studies that examined the use of research evidence by policymakers to inform decisions about public health. To locate studies, we will search nine bibliographic databases, hand-search nine public health and policy journals and scan the websites of relevant organisations and the reference lists of previous reviews of evidence use in policymaking. Two reviewers will independently screen studies, apply inclusion criteria and appraise the quality of included studies. Data will be coded inductively and analysed using thematic synthesis. An augmented version of the CASP Qualitative Checklist will be used to appraise included studies, and the CERQual tool will be used to assess confidence in the review’s findings. The review’s results will be presented narratively and in tabular form. Synthesis findings will be summarised as a taxonomy of factors affecting evidence use in public health policymaking. A conceptual framework explaining the relationships between key factors will be proposed. Implications and recommendations for policy, practice and future research will be discussed.

Discussion

This review will be the most comprehensive to date to synthesise the qualitative literature on evidence use by public health policymakers and will be the first to apply a formal method of qualitative metasynthesis to this body of evidence. Its results will be useful both to scholars of evidence use and knowledge translation and to decision-makers and academics attempting to influence public health policy.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lasswell HD. Politics: who gets what, when, how. New York: P. Smith; 1950. Lasswell HD. Politics: who gets what, when, how. New York: P. Smith; 1950.
2.
go back to reference Barnes A, Parkhurst J. Can global health policy be depoliticized? A critique of global calls for evidence-based policy. In: Brown GW, Yamey G, Wamala S, editors. The Handbook of Global Health Policy. West Sussex: Wiley-Blackwell; 2014. p. 157–73.CrossRef Barnes A, Parkhurst J. Can global health policy be depoliticized? A critique of global calls for evidence-based policy. In: Brown GW, Yamey G, Wamala S, editors. The Handbook of Global Health Policy. West Sussex: Wiley-Blackwell; 2014. p. 157–73.CrossRef
3.
go back to reference Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A Systematic Review PloS one. 2013;8(10):e77404.CrossRefPubMed Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A Systematic Review PloS one. 2013;8(10):e77404.CrossRefPubMed
4.
go back to reference Porter D. Health, civilization, and the state: a history of public health from ancient to modern times. London and New York: Routledge; 1999. Porter D. Health, civilization, and the state: a history of public health from ancient to modern times. London and New York: Routledge; 1999.
6.
go back to reference White M, Adams J, Heywood P. How and why do interventions that increase health overall widen inequalities within populations. In: Babones SJ, editor. Social inequality and public health. Bristol: Policy Press; 2009. p. 65-82. White M, Adams J, Heywood P. How and why do interventions that increase health overall widen inequalities within populations. In: Babones SJ, editor. Social inequality and public health. Bristol: Policy Press; 2009. p. 65-82.
8.
go back to reference Oliver K, Innvær S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14(1):2.CrossRefPubMedPubMedCentral Oliver K, Innvær S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14(1):2.CrossRefPubMedPubMedCentral
9.
go back to reference Innvær S, Vist G, Trommald M, Oxman A. Health policy-makers' perceptions of their use of evidence: a systematic review. Journal of Health Services Research & Policy. 2002;7(4):239–44.CrossRef Innvær S, Vist G, Trommald M, Oxman A. Health policy-makers' perceptions of their use of evidence: a systematic review. Journal of Health Services Research & Policy. 2002;7(4):239–44.CrossRef
10.
go back to reference Orton L, Lloyd-Williams F, Taylor-Robinson D, O'Flaherty M, Capewell S. The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011;6(7):e21704.CrossRefPubMedPubMedCentral Orton L, Lloyd-Williams F, Taylor-Robinson D, O'Flaherty M, Capewell S. The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011;6(7):e21704.CrossRefPubMedPubMedCentral
11.
go back to reference Thorne S, Jensen L, Kearney MH, Noblit G, Sandelowski M. Qualitative metasynthesis: reflections on methodological orientation and ideological agenda. Qual Health Res. 2004;14(10):1342–65.CrossRefPubMed Thorne S, Jensen L, Kearney MH, Noblit G, Sandelowski M. Qualitative metasynthesis: reflections on methodological orientation and ideological agenda. Qual Health Res. 2004;14(10):1342–65.CrossRefPubMed
12.
go back to reference Noblit GW, Hare RD. Meta-ethnography: synthesizing qualitative studies. Newbury Park, California: Sage Publications; 1988.CrossRef Noblit GW, Hare RD. Meta-ethnography: synthesizing qualitative studies. Newbury Park, California: Sage Publications; 1988.CrossRef
15.
go back to reference Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database of Systematic Reviews. 2013(10). doi:10.1002/14651858.CD010414.pub2. Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database of Systematic Reviews. 2013(10). doi:10.​1002/​14651858.​CD010414.​pub2.
16.
go back to reference Noyes J, Popay J. Directly observed therapy and tuberculosis: how can a systematic review of qualitative research contribute to improving services? A qualitative meta-synthesis. J Adv Nurs. 2007;57(3):227–43.CrossRefPubMed Noyes J, Popay J. Directly observed therapy and tuberculosis: how can a systematic review of qualitative research contribute to improving services? A qualitative meta-synthesis. J Adv Nurs. 2007;57(3):227–43.CrossRefPubMed
17.
go back to reference Munro SA, Lewin SA, Smith HJ, Engel ME, Fretheim A, Volmink J. Patient adherence to tuberculosis treatment: a systematic review of qualitative research. PLoS Med. 2007;4(7):e238.CrossRefPubMedPubMedCentral Munro SA, Lewin SA, Smith HJ, Engel ME, Fretheim A, Volmink J. Patient adherence to tuberculosis treatment: a systematic review of qualitative research. PLoS Med. 2007;4(7):e238.CrossRefPubMedPubMedCentral
18.
go back to reference Noyes J, Lewin S, et al. Chapter 5: extracting qualitative evidence. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, editors. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. . Cochrane Collaboration Qualitative Methods Group. 2011. Noyes J, Lewin S, et al. Chapter 5: extracting qualitative evidence. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, editors. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. . Cochrane Collaboration Qualitative Methods Group. 2011.
19.
go back to reference Walsh D, Downe S. Meta-synthesis method for qualitative research: a literature review. J Adv Nurs. 2005;50(2):204–11.CrossRefPubMed Walsh D, Downe S. Meta-synthesis method for qualitative research: a literature review. J Adv Nurs. 2005;50(2):204–11.CrossRefPubMed
20.
go back to reference Carroll C, Booth A. Quality assessment of qualitative evidence for systematic review and synthesis: is it meaningful, and if so, how should it be performed? Research Synthesis Methods. 2015;6(2):149–54. doi:10.1002/jrsm.1128.CrossRefPubMed Carroll C, Booth A. Quality assessment of qualitative evidence for systematic review and synthesis: is it meaningful, and if so, how should it be performed? Research Synthesis Methods. 2015;6(2):149–54. doi:10.​1002/​jrsm.​1128.CrossRefPubMed
21.
go back to reference Cairney P. Understanding public policy: theories and issues. Palgrave Macmillan. 2011. Cairney P. Understanding public policy: theories and issues. Palgrave Macmillan. 2011.
22.
go back to reference Smith KE, Katikireddi SV. A glossary of theories for understanding policymaking. J Epidemiol Community Health. 2013;67(2):198–202.CrossRefPubMed Smith KE, Katikireddi SV. A glossary of theories for understanding policymaking. J Epidemiol Community Health. 2013;67(2):198–202.CrossRefPubMed
23.
go back to reference Perrier L, Mrklas K, Lavis JN, Straus SE. Interventions encouraging the use of systematic reviews by health policymakers and managers: a systematic review. Implement Sci. 2011;6(1):43.CrossRefPubMedPubMedCentral Perrier L, Mrklas K, Lavis JN, Straus SE. Interventions encouraging the use of systematic reviews by health policymakers and managers: a systematic review. Implement Sci. 2011;6(1):43.CrossRefPubMedPubMedCentral
24.
go back to reference Humphries S, Stafinski T, Mumtaz Z, Menon D. Barriers and facilitators to evidence-use in program management: a systematic review of the literature. BMC Health Serv Res. 2014;14(1):171.CrossRefPubMedPubMedCentral Humphries S, Stafinski T, Mumtaz Z, Menon D. Barriers and facilitators to evidence-use in program management: a systematic review of the literature. BMC Health Serv Res. 2014;14(1):171.CrossRefPubMedPubMedCentral
25.
go back to reference Lorenc T, Tyner EF, Petticrew M, Duffy S, Martineau FP, Phillips G, et al. Cultures of evidence across policy sectors: systematic review of qualitative evidence. The European Journal of Public Health. 2014;24(6):1041–7.CrossRefPubMed Lorenc T, Tyner EF, Petticrew M, Duffy S, Martineau FP, Phillips G, et al. Cultures of evidence across policy sectors: systematic review of qualitative evidence. The European Journal of Public Health. 2014;24(6):1041–7.CrossRefPubMed
26.
go back to reference Marmot M, Wilkinson R. Social determinants of health. Oxford: Oxford University Press; 2005.CrossRef Marmot M, Wilkinson R. Social determinants of health. Oxford: Oxford University Press; 2005.CrossRef
27.
go back to reference Marmot M, Friel S, Bell R, Houweling TA, Taylor S. Closing the gap in a generation: health equity through action on the social determinants of health. Lancet. 2008;372(9650):1661–9.CrossRefPubMed Marmot M, Friel S, Bell R, Houweling TA, Taylor S. Closing the gap in a generation: health equity through action on the social determinants of health. Lancet. 2008;372(9650):1661–9.CrossRefPubMed
28.
go back to reference Saini M, Shlonsky A. Systematic synthesis of qualitative research. Oxford: Oxford University Press; 2012.CrossRef Saini M, Shlonsky A. Systematic synthesis of qualitative research. Oxford: Oxford University Press; 2012.CrossRef
29.
go back to reference Booth A, Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, et al. Chapter 3: searching for studies. In: Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. Cochrane Collaboration Qualitative Methods Group. 2011. Booth A, Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, et al. Chapter 3: searching for studies. In: Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. Cochrane Collaboration Qualitative Methods Group. 2011.
30.
go back to reference Petticrew M, Roberts H. Systematic reviews in the social sciences: a practical guide. Oxford: John Wiley & Sons; 2008. Petticrew M, Roberts H. Systematic reviews in the social sciences: a practical guide. Oxford: John Wiley & Sons; 2008.
32.
go back to reference Hannes K, Lockwood C, Pearson A. A comparative analysis of three online appraisal instruments’ ability to assess validity in qualitative research. Qual Health Res. 2010;20(12):1736–43.CrossRefPubMed Hannes K, Lockwood C, Pearson A. A comparative analysis of three online appraisal instruments’ ability to assess validity in qualitative research. Qual Health Res. 2010;20(12):1736–43.CrossRefPubMed
33.
go back to reference The Joanna Briggs Institute. Joanna Briggs Institute Reviewers’ Manual. Adelaide, Australia: The Joanna Briggs Institute; 2014. The Joanna Briggs Institute. Joanna Briggs Institute Reviewers’ Manual. Adelaide, Australia: The Joanna Briggs Institute; 2014.
34.
go back to reference Hannes K et al. Chapter 4: critical appraisal of qualitative research. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, editors. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. . Cochrane Collaboration Qualitative Methods Group. 2011. Hannes K et al. Chapter 4: critical appraisal of qualitative research. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, editors. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. . Cochrane Collaboration Qualitative Methods Group. 2011.
35.
go back to reference Boeije HR, van Wesel F, Alisic E. Making a difference: towards a method for weighing the evidence in a qualitative synthesis. J Eval Clin Pract. 2011;17(4):657–63.CrossRefPubMed Boeije HR, van Wesel F, Alisic E. Making a difference: towards a method for weighing the evidence in a qualitative synthesis. J Eval Clin Pract. 2011;17(4):657–63.CrossRefPubMed
36.
go back to reference Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, et al. Chapter 1: preparing a protocol for Cochrane intervention reviews including qualitative research. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, editors. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. . Cochrane Collaboration Qualitative Methods Group. 2011. Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, et al. Chapter 1: preparing a protocol for Cochrane intervention reviews including qualitative research. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, editors. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. . Cochrane Collaboration Qualitative Methods Group. 2011.
37.
go back to reference Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin C, Gülmezoglu M, et al. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLoS Med. 2015;12(10):e1001895. doi:10.1371/journal.pmed.1001895.CrossRefPubMedPubMedCentral Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin C, Gülmezoglu M, et al. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLoS Med. 2015;12(10):e1001895. doi:10.​1371/​journal.​pmed.​1001895.CrossRefPubMedPubMedCentral
38.
go back to reference Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol. 2011;64(4):380–2.CrossRefPubMed Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol. 2011;64(4):380–2.CrossRefPubMed
39.
go back to reference Rashidian A, Shakibazadeh E, Karimi-Shahanjarini A, Glenton C, Noyes J, Lewin S et al. Barriers and facilitators to the implementation of doctor—nurse substitution strategies in primary care: qualitative evidence synthesis (Protocol). Cochrane Database of Systematic Reviews. 2013(2). doi:10.1002/14651858.CD010412. Rashidian A, Shakibazadeh E, Karimi-Shahanjarini A, Glenton C, Noyes J, Lewin S et al. Barriers and facilitators to the implementation of doctor—nurse substitution strategies in primary care: qualitative evidence synthesis (Protocol). Cochrane Database of Systematic Reviews. 2013(2). doi:10.​1002/​14651858.​CD010412.
40.
go back to reference Bohren MA, Hunter EC, Munthe-Kaas HM, Souza JP, Vogel JP, Gülmezoglu AM. Facilitators and barriers to facility-based delivery in low-and middle-income countries: a qualitative evidence synthesis. Reprod Health. 2014;11(1):71.CrossRefPubMedPubMedCentral Bohren MA, Hunter EC, Munthe-Kaas HM, Souza JP, Vogel JP, Gülmezoglu AM. Facilitators and barriers to facility-based delivery in low-and middle-income countries: a qualitative evidence synthesis. Reprod Health. 2014;11(1):71.CrossRefPubMedPubMedCentral
41.
go back to reference Colvin CJ, Smith HJ, Swartz A, Ahs JW, de Heer J, Opiyo N, et al. Understanding careseeking for child illness in sub-Saharan Africa: a systematic review and conceptual framework based on qualitative research of household recognition and response to child diarrhoea, pneumonia and malaria. Soc Sci Med. 2013;86:66–78.CrossRefPubMed Colvin CJ, Smith HJ, Swartz A, Ahs JW, de Heer J, Opiyo N, et al. Understanding careseeking for child illness in sub-Saharan Africa: a systematic review and conceptual framework based on qualitative research of household recognition and response to child diarrhoea, pneumonia and malaria. Soc Sci Med. 2013;86:66–78.CrossRefPubMed
42.
go back to reference Munthe-Kaas H, Hammerstrøm K, Kurtze N, Nordlund K. Effekt av og erfaringer med kontinuitetsfremmende tiltak i barnevernsinstitusjoner [Effects and experiences of interventions to promote continuity in residential child care institutions]. 2013. p. 4. Rapport fra Kunnskapssenteret [Report for the Norwegian Knowledge Centre]. Munthe-Kaas H, Hammerstrøm K, Kurtze N, Nordlund K. Effekt av og erfaringer med kontinuitetsfremmende tiltak i barnevernsinstitusjoner [Effects and experiences of interventions to promote continuity in residential child care institutions]. 2013. p. 4. Rapport fra Kunnskapssenteret [Report for the Norwegian Knowledge Centre].
44.
go back to reference Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1.CrossRefPubMedPubMedCentral Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1.CrossRefPubMedPubMedCentral
45.
go back to reference Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181.CrossRefPubMedPubMedCentral Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181.CrossRefPubMedPubMedCentral
46.
go back to reference Booth A. “Brimful of STARLITE”: toward standards for reporting literature searches. Journal of the Medical Library Association. 2006;94(4):421.PubMedPubMedCentral Booth A. “Brimful of STARLITE”: toward standards for reporting literature searches. Journal of the Medical Library Association. 2006;94(4):421.PubMedPubMedCentral
47.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.CrossRefPubMed
Metadata
Title
What factors affect evidence-informed policymaking in public health? Protocol for a systematic review of qualitative evidence using thematic synthesis
Authors
Ben Verboom
Paul Montgomery
Sara Bennett
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-016-0240-6

Other articles of this Issue 1/2016

Systematic Reviews 1/2016 Go to the issue