Skip to main content
Top
Published in: Systematic Reviews 1/2016

Open Access 01-12-2016 | Protocol

Supporting successful implementation of public health interventions: protocol for a realist synthesis

Authors: Marjorie MacDonald, Bernadette Pauly, Geoff Wong, Kara Schick-Makaroff, Thea van Roode, Heather Wilson Strosher, Anita Kothari, Ruta Valaitis, Heather Manson, Warren O’Briain, Simon Carroll, Victoria Lee, Samantha Tong, Karen Dickenson Smith, Megan Ward

Published in: Systematic Reviews | Issue 1/2016

Login to get access

Abstract

Background

There is a growing emphasis in public health on the importance of evidence-based interventions to improve population health and reduce health inequities. Equally important is the need for knowledge about how to implement these interventions successfully. Yet, a gap remains between the development of evidence-based public health interventions and their successful implementation. Conventional systematic reviews have been conducted on effective implementation in health care, but few in public health, so their relevance to public health is unclear. In most reviews, stringent inclusion criteria have excluded entire bodies of evidence that may be relevant for policy makers, program planners, and practitioners to understand implementation in the unique public health context. Realist synthesis is a theory-driven methodology that draws on diverse data from different study designs to explain how and why observed outcomes occur in different contexts and thus may be more appropriate for public health.

Methods

This paper presents a realist review protocol to answer the research question: Why are some public health interventions successfully implemented and others not? Based on a review of implementation theories and frameworks, we developed an initial program theory, adapted for public health from the Consolidated Framework for Implementation Research, to explain the implementation outcomes of public health interventions within particular contexts. This will guide us through the review process, which comprises eight iterative steps based on established realist review guidelines and quality standards. We aim to refine this initial theory into a ‘final’ realist program theory that explains important context-mechanism-outcome configurations in the successful implementation of public health interventions.

Discussion

Developing new public health interventions is costly and policy windows that support their implementation can be short lived. Ineffective implementation wastes scarce resources and is neither affordable nor sustainable. Public health interventions that are not implemented will not have their intended effects on improving population health and promoting health equity. This synthesis will provide evidence to support effective implementation of public health interventions taking into account the variable context of interventions. A series of knowledge translation products specific to the needs of knowledge users will be developed to provide implementation support.

Systematic review registration

PROSPERO CRD42015030052
Appendix
Available only for authorised users
Literature
2.
go back to reference Graham I, Logan J, Harrison MB, Straus S, Tetroe J, Caswell W, Robinson N. Lost in translation: time for a new map? J Contin Educ Health. 2006;26:13–24.CrossRef Graham I, Logan J, Harrison MB, Straus S, Tetroe J, Caswell W, Robinson N. Lost in translation: time for a new map? J Contin Educ Health. 2006;26:13–24.CrossRef
4.
go back to reference Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41:171–81.CrossRefPubMed Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41:171–81.CrossRefPubMed
5.
go back to reference Saul J, Wandersman A, Flaspohler P, Duffy J, Lubell K, Noonan R. Research and action for bridging science and practice in prevention. Am J Community Psychol. 2008;41:165–70.CrossRefPubMed Saul J, Wandersman A, Flaspohler P, Duffy J, Lubell K, Noonan R. Research and action for bridging science and practice in prevention. Am J Community Psychol. 2008;41:165–70.CrossRefPubMed
6.
go back to reference Krisberg K. Budget cuts straining capacity of public health departments: services in demand. Nation’s Health. 2010;40(4):1–16. Krisberg K. Budget cuts straining capacity of public health departments: services in demand. Nation’s Health. 2010;40(4):1–16.
7.
go back to reference Cooper AF, Kirton J, editors. Innovation in global health governance: critical cases. Surrey: Ashgate Publishing Ltd; 2009. Cooper AF, Kirton J, editors. Innovation in global health governance: critical cases. Surrey: Ashgate Publishing Ltd; 2009.
8.
go back to reference Exworthy M. Policy to tackle the social determinants of health: using conceptual models to understand the policy process. Health Policy Plan. 2008;23(5):318–27.CrossRefPubMed Exworthy M. Policy to tackle the social determinants of health: using conceptual models to understand the policy process. Health Policy Plan. 2008;23(5):318–27.CrossRefPubMed
12.
go back to reference Fixsen DL, Naoom SF, Blasé KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa: University of South Florida. The National Implementation Research Network; 2005. Fixsen DL, Naoom SF, Blasé KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa: University of South Florida. The National Implementation Research Network; 2005.
13.
go back to reference Greenhalgh T, Robert G, Bate P, Macfarlane F, Kyriakidou O. Diffusion of innovations in health services organizations: a systematic literature review. Oxford: Blackwell Publishing; 2005.CrossRef Greenhalgh T, Robert G, Bate P, Macfarlane F, Kyriakidou O. Diffusion of innovations in health services organizations: a systematic literature review. Oxford: Blackwell Publishing; 2005.CrossRef
14.
go back to reference Helfrich CD, Weiner BJ, McKinney MM, Minasian L. Determinants of implementation effectiveness: adapting a framework for complex innovations. Med Care Res Rev. 2007;64:279–303.CrossRefPubMed Helfrich CD, Weiner BJ, McKinney MM, Minasian L. Determinants of implementation effectiveness: adapting a framework for complex innovations. Med Care Res Rev. 2007;64:279–303.CrossRefPubMed
15.
go back to reference Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomas MA. Getting research findings into practice: an overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J. 1998;317:465–8.CrossRef Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomas MA. Getting research findings into practice: an overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J. 1998;317:465–8.CrossRef
17.
go back to reference Kelly M, Morgan A, Ellis S, Younger T, Huntley J, Swann C. Evidence based public health: a review of the experience of the National Institute of Health and Clinical Excellence (NICE) of developing public health guidance in England. Soc Sci Med. 2010;71(6):1056–62. http://dx.doi.org/10.1016/j.socscimed.2010.06.032.CrossRefPubMed Kelly M, Morgan A, Ellis S, Younger T, Huntley J, Swann C. Evidence based public health: a review of the experience of the National Institute of Health and Clinical Excellence (NICE) of developing public health guidance in England. Soc Sci Med. 2010;71(6):1056–62. http://​dx.​doi.​org/​10.​1016/​j.​socscimed.​2010.​06.​032.CrossRefPubMed
18.
go back to reference LaRocca R, Yost J, Dobbins M, Ciliska D. The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health. 2012;12:751.CrossRefPubMedPubMedCentral LaRocca R, Yost J, Dobbins M, Ciliska D. The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health. 2012;12:751.CrossRefPubMedPubMedCentral
19.
go back to reference Rootman I, Goodstadt M, Hyndman B, McQueen D, Potvin L, Springett J, Ziglio E. Evaluation in health promotion: principles and perspectives. Geneva: World Health Organization; 2001. Rootman I, Goodstadt M, Hyndman B, McQueen D, Potvin L, Springett J, Ziglio E. Evaluation in health promotion: principles and perspectives. Geneva: World Health Organization; 2001.
20.
go back to reference Pawson R. Evidence-based policy: in search of a method. Evaluation. 2002a;8(2):219–28. Pawson R. Evidence-based policy: in search of a method. Evaluation. 2002a;8(2):219–28.
21.
go back to reference Pawson R. Evidence-based policy: the promise of “realist synthesis”. Evaluation. 2002b;8(3):340–58. Pawson R. Evidence-based policy: the promise of “realist synthesis”. Evaluation. 2002b;8(3):340–58.
22.
go back to reference Pawson R. Evidence based policy: a realist perspective. London: Sage Publications; 2006. Pawson R. Evidence based policy: a realist perspective. London: Sage Publications; 2006.
24.
go back to reference Salter KJ, Kothari A. Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review. Implement Sci. 2014;9:155. insert Cochrane after this.CrossRef Salter KJ, Kothari A. Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review. Implement Sci. 2014;9:155. insert Cochrane after this.CrossRef
25.
go back to reference Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review—a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10 Suppl 1:21–34.CrossRefPubMed Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review—a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10 Suppl 1:21–34.CrossRefPubMed
27.
go back to reference Wong G, Greenhalgh T, Westhorp G, Pawson R. Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (Realist And Meta-narrative Evidence Syntheses - Evolving Standards) project. Health Serv Deliv Res 2014;2(30). http://www.ncbi.nlm.nih.gov/books/NBK260013/. DOI: 10.3310/hsdr02300. Wong G, Greenhalgh T, Westhorp G, Pawson R. Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (Realist And Meta-narrative Evidence Syntheses - Evolving Standards) project. Health Serv Deliv Res 2014;2(30). http://​www.​ncbi.​nlm.​nih.​gov/​books/​NBK260013/​. DOI: 10.3310/hsdr02300.
29.
go back to reference Ontario Ministry of Health and Long-Term Care. Ontario Public Health Standards, 2008. Toronto: Queen’s Printer for Ontario; 2008. Ontario Ministry of Health and Long-Term Care. Ontario Public Health Standards, 2008. Toronto: Queen’s Printer for Ontario; 2008.
31.
go back to reference Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, the PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647. doi:10.1136/bmj.g7647.CrossRefPubMed Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, the PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647. doi:10.​1136/​bmj.​g7647.CrossRefPubMed
33.
go back to reference Ontario Agency for Health Protection and Promotion (Public Health Ontario). Public Health Ontario Strategic Plan 2014–2019: evidence, knowledge and action for a healthier Ontario. Toronto: Queen’s Printer for Ontario; 2013. Ontario Agency for Health Protection and Promotion (Public Health Ontario). Public Health Ontario Strategic Plan 2014–2019: evidence, knowledge and action for a healthier Ontario. Toronto: Queen’s Printer for Ontario; 2013.
35.
go back to reference Kothari A, Wathen N. A critical second look at integrated knowledge translation. Health Policy. 2013;109(2):187–91.CrossRefPubMed Kothari A, Wathen N. A critical second look at integrated knowledge translation. Health Policy. 2013;109(2):187–91.CrossRefPubMed
43.
go back to reference QSR International. NVivo qualitative data analysis software. Version 10. Doncaster, Victoria, Australia: QSR International Pty Ltd; 2012. QSR International. NVivo qualitative data analysis software. Version 10. Doncaster, Victoria, Australia: QSR International Pty Ltd; 2012.
44.
go back to reference Miles M, Huberman A. Qualitative data analysis: an expanded sourcebook. Thousand Oaks: Sage Publications; 1994. Miles M, Huberman A. Qualitative data analysis: an expanded sourcebook. Thousand Oaks: Sage Publications; 1994.
45.
go back to reference Travis P, Egger D, Davies P, Mechbal A. Towards better stewardship: concepts and critical issues. Geneva: World Health Organization; 2002. http://www.who.int/healthinfo/paper48.pdf Accessed 11 December 2015. Travis P, Egger D, Davies P, Mechbal A. Towards better stewardship: concepts and critical issues. Geneva: World Health Organization; 2002. http://​www.​who.​int/​healthinfo/​paper48.​pdf Accessed 11 December 2015.
Metadata
Title
Supporting successful implementation of public health interventions: protocol for a realist synthesis
Authors
Marjorie MacDonald
Bernadette Pauly
Geoff Wong
Kara Schick-Makaroff
Thea van Roode
Heather Wilson Strosher
Anita Kothari
Ruta Valaitis
Heather Manson
Warren O’Briain
Simon Carroll
Victoria Lee
Samantha Tong
Karen Dickenson Smith
Megan Ward
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-016-0229-1

Other articles of this Issue 1/2016

Systematic Reviews 1/2016 Go to the issue