Skip to main content
Top
Published in: BMC Public Health 1/2012

Open Access 01-12-2012 | Study protocol

Methods for evaluating the impact of vertical programs on health systems: protocol for a study on the impact of the global polio eradication initiative on strengthening routine immunization and primary health care

Authors: Svea Closser, Anat Rosenthal, Thomas Parris, Kenneth Maes, Judith Justice, Kelly Cox, Matthew A Luck, R Matthew Landis, John Grove, Pauley Tedoff, Linda Venczel, Peter Nsubuga, Jennifer Kuzara, Vanessa Neergheen

Published in: BMC Public Health | Issue 1/2012

Login to get access

Abstract

Background

The impact of vertical programs on health systems is a much-debated topic, and more evidence on this complex relationship is needed. This article describes a research protocol developed to assess the relationship between the Global Polio Eradication Initiative, routine immunization, and primary health care in multiple settings.

Methods/Design

This protocol was designed as a combination of quantitative and qualitative research methods, making use of comparative ethnographies. The study evaluates the impact of the Global Polio Eradication Initiative on routine immunization and primary health care by: (a) combining quantitative and qualitative work into one coherent study design; (b) using purposively selected qualitative case studies to systematically evaluate the impact of key contextual variables; and (c) making extensive use of the method of participant observation to create comparative ethnographies of the impact of a single vertical program administered in varied contexts.

Discussion

The study design has four major benefits: (1) the careful selection of a range of qualitative case studies allowed for systematic comparison; (2) the use of participant observation yielded important insights on how policy is put into practice; (3) results from our quantitative analysis could be explained by results from qualitative work; and (4) this research protocol can inform the creation of actionable recommendations. Here, recommendations for how to overcome potential challenges in carrying out such research are presented. This study illustrates the utility of mixed-methods research designs in which qualitative data are not just used to embellish quantitative results, but are an integral component of the analysis.
Literature
1.
2.
go back to reference Garrett L: The challenge of global health. Foreign Affairs. 2007, 86: 14- Garrett L: The challenge of global health. Foreign Affairs. 2007, 86: 14-
3.
go back to reference Bosch-Capblanch X, Lavis JN, Lewin S, Atun R, Røttingen J-A, Dröschel D, Beck L, Abalos E, El-Jardali F, Gilson L, Oliver S, Wyss K, Tugwell P, Kulier R, Pang T, Haines A: Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development. PLoS Med. 2012, 9: e1001185-10.1371/journal.pmed.1001185.CrossRefPubMedPubMedCentral Bosch-Capblanch X, Lavis JN, Lewin S, Atun R, Røttingen J-A, Dröschel D, Beck L, Abalos E, El-Jardali F, Gilson L, Oliver S, Wyss K, Tugwell P, Kulier R, Pang T, Haines A: Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development. PLoS Med. 2012, 9: e1001185-10.1371/journal.pmed.1001185.CrossRefPubMedPubMedCentral
4.
go back to reference Lavis JN, Røttingen J-A, Bosch-Capblanch X, Atun R, El-Jardali F, Gilson L, Lewin S, Oliver S, Ongolo-Zogo P, Haines A: Guidance for evidence-informed policies about health systems: linking guidance development to policy development. PLoS Med. 2012, 9: e1001186-10.1371/journal.pmed.1001186.CrossRefPubMedPubMedCentral Lavis JN, Røttingen J-A, Bosch-Capblanch X, Atun R, El-Jardali F, Gilson L, Lewin S, Oliver S, Ongolo-Zogo P, Haines A: Guidance for evidence-informed policies about health systems: linking guidance development to policy development. PLoS Med. 2012, 9: e1001186-10.1371/journal.pmed.1001186.CrossRefPubMedPubMedCentral
5.
go back to reference Lewin S, Bosch-Capblanch X, Oliver S, Akl EA, Vist GE, Lavis JN, Ghersi D, Røttingen J-A, Steinmann P, Gulmezoglu M, Tugwell P, El-Jardali F, Haines A: Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence. PLoS Med. 2012, 9: e1001187-10.1371/journal.pmed.1001187.CrossRefPubMedPubMedCentral Lewin S, Bosch-Capblanch X, Oliver S, Akl EA, Vist GE, Lavis JN, Ghersi D, Røttingen J-A, Steinmann P, Gulmezoglu M, Tugwell P, El-Jardali F, Haines A: Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence. PLoS Med. 2012, 9: e1001187-10.1371/journal.pmed.1001187.CrossRefPubMedPubMedCentral
6.
go back to reference Glassman A, Chalkidou K: Priority-Setting in Health: Building Institutions for Smarter Public Spending. 2012, Washington, DC: Center for Global Development Glassman A, Chalkidou K: Priority-Setting in Health: Building Institutions for Smarter Public Spending. 2012, Washington, DC: Center for Global Development
7.
go back to reference Cavalli A, Bamba S, Traore M, Boelart M, Coulibaly Y, Polman K, Pirard M, Dormael M: Interactions between global health initiatives and country health systems: the case of a neglected tropical diseases control program in Mali. PLoS Negl Trop Dis. 2010, 4: e798-10.1371/journal.pntd.0000798.CrossRefPubMedPubMedCentral Cavalli A, Bamba S, Traore M, Boelart M, Coulibaly Y, Polman K, Pirard M, Dormael M: Interactions between global health initiatives and country health systems: the case of a neglected tropical diseases control program in Mali. PLoS Negl Trop Dis. 2010, 4: e798-10.1371/journal.pntd.0000798.CrossRefPubMedPubMedCentral
8.
go back to reference Coulibaly Y, Cavalli A, van Dormael M, Polman K, Kegels G: Programme activities: a major burden for district health systems?. Trop Med Int Health. 2008, 13: 1430-1432. 10.1111/j.1365-3156.2008.02174.x.CrossRefPubMed Coulibaly Y, Cavalli A, van Dormael M, Polman K, Kegels G: Programme activities: a major burden for district health systems?. Trop Med Int Health. 2008, 13: 1430-1432. 10.1111/j.1365-3156.2008.02174.x.CrossRefPubMed
9.
go back to reference The Maximizing Positive Synergies Academic Consortium: Interactions between Global Health Initiatives and Health Systems: Evidence from Countries. 2009, Geneva: World Health Organization The Maximizing Positive Synergies Academic Consortium: Interactions between Global Health Initiatives and Health Systems: Evidence from Countries. 2009, Geneva: World Health Organization
10.
go back to reference Hanvoravongchai P, Mounier-Jack S, Oliveira Cruz V, Balabanova D, Biellik R, Kitaw Y, Koehlmoos T, Loureiro S, Molla M, Nguyen H, Ongolo-Zogo P, Sadykova U, Sarma H, Teixeira M, Uddin J, Dabbagh A, Griffiths UK: Impact of measles elimination activities on immunization services and health systems: findings from six countries. J Infect Dis. 2011, 204: S82-S89. 10.1093/infdis/jir091.CrossRefPubMed Hanvoravongchai P, Mounier-Jack S, Oliveira Cruz V, Balabanova D, Biellik R, Kitaw Y, Koehlmoos T, Loureiro S, Molla M, Nguyen H, Ongolo-Zogo P, Sadykova U, Sarma H, Teixeira M, Uddin J, Dabbagh A, Griffiths UK: Impact of measles elimination activities on immunization services and health systems: findings from six countries. J Infect Dis. 2011, 204: S82-S89. 10.1093/infdis/jir091.CrossRefPubMed
11.
go back to reference Verguet S, Jassat W, Hedberg C, Tollman S, Jamison DT, Hofman KJ: Measles control in Sub-Saharan Africa: South Africa as a case study. Vaccine. 2012, 30: 1594-1600. 10.1016/j.vaccine.2011.12.123.CrossRefPubMed Verguet S, Jassat W, Hedberg C, Tollman S, Jamison DT, Hofman KJ: Measles control in Sub-Saharan Africa: South Africa as a case study. Vaccine. 2012, 30: 1594-1600. 10.1016/j.vaccine.2011.12.123.CrossRefPubMed
12.
go back to reference World Health Organization: Global Polio Eradication Initiative Strategic Plan 2004–2008. 2003, Geneva: WHO World Health Organization: Global Polio Eradication Initiative Strategic Plan 2004–2008. 2003, Geneva: WHO
13.
go back to reference World Health Organization: UNICEF: Global Polio Eradication Initiative Financial Resource Requirements 2012–2013 As of 1 May 2012. 2012, Geneva: WHO World Health Organization: UNICEF: Global Polio Eradication Initiative Financial Resource Requirements 2012–2013 As of 1 May 2012. 2012, Geneva: WHO
14.
go back to reference Bonu S, Rani M, Baker T: The impact of the national polio immunization campaign on levels and equity in immunization coverage: evidence from rural North India. Soc Sci Med. 2003, 57: 1807-1819. 10.1016/S0277-9536(03)00056-X.CrossRefPubMed Bonu S, Rani M, Baker T: The impact of the national polio immunization campaign on levels and equity in immunization coverage: evidence from rural North India. Soc Sci Med. 2003, 57: 1807-1819. 10.1016/S0277-9536(03)00056-X.CrossRefPubMed
15.
go back to reference Bonu S, Rani M, Razum O: Global public health mandates in a diverse world: the polio eradication initiative and the expanded programme on immunization in Sub-Saharan Africa and South Asia. Health Policy. 2004, 70: 327-345. 10.1016/j.healthpol.2004.04.005.CrossRefPubMed Bonu S, Rani M, Razum O: Global public health mandates in a diverse world: the polio eradication initiative and the expanded programme on immunization in Sub-Saharan Africa and South Asia. Health Policy. 2004, 70: 327-345. 10.1016/j.healthpol.2004.04.005.CrossRefPubMed
16.
go back to reference Loevinsohn B, Aylward B, Steinglass R, Ogden E, Goodman T, Melgaard B: Impact of targeted programs on health systems: a case study of the polio eradication initiative. Am J Public Health. 2002, 92: 19-23. 10.2105/AJPH.92.1.19.CrossRefPubMedPubMedCentral Loevinsohn B, Aylward B, Steinglass R, Ogden E, Goodman T, Melgaard B: Impact of targeted programs on health systems: a case study of the polio eradication initiative. Am J Public Health. 2002, 92: 19-23. 10.2105/AJPH.92.1.19.CrossRefPubMedPubMedCentral
17.
go back to reference Pan American Health Organization: The Impact of the Expanded Program on Immuniztion and the Polio Eradication Initiative on Health Systems in the Americas: Final Report of the “Taylor Commission”. 1995, Washington, DC: PAHO Pan American Health Organization: The Impact of the Expanded Program on Immuniztion and the Polio Eradication Initiative on Health Systems in the Americas: Final Report of the “Taylor Commission”. 1995, Washington, DC: PAHO
18.
go back to reference Taylor CE, Cutts F, Taylor ME: Ethical dilemmas in current planning for polio eradication. Am J Public Health. 1997, 87: 922-925. 10.2105/AJPH.87.6.922.CrossRefPubMedPubMedCentral Taylor CE, Cutts F, Taylor ME: Ethical dilemmas in current planning for polio eradication. Am J Public Health. 1997, 87: 922-925. 10.2105/AJPH.87.6.922.CrossRefPubMedPubMedCentral
19.
go back to reference Dietz V, Cutts F: The use of mass campaigns in the expanded program on immunization: a review of reported advantages and disadvantages. Int J Health Serv. 1997, 27: 767-790. 10.2190/QPCQ-FBF8-6ABX-2TB5.CrossRefPubMed Dietz V, Cutts F: The use of mass campaigns in the expanded program on immunization: a review of reported advantages and disadvantages. Int J Health Serv. 1997, 27: 767-790. 10.2190/QPCQ-FBF8-6ABX-2TB5.CrossRefPubMed
20.
go back to reference World Health Organization: Meeting on the Impact of Targeted Programmes on Health Systems: A Case Study of the Polio Eradication Initiative. 2000, Geneva: WHO World Health Organization: Meeting on the Impact of Targeted Programmes on Health Systems: A Case Study of the Polio Eradication Initiative. 2000, Geneva: WHO
21.
go back to reference Mogedal S, Stenson B: Disease Eradication: Friend or Foe to the Health System?. 2000, Geneva: WHO, 29- Mogedal S, Stenson B: Disease Eradication: Friend or Foe to the Health System?. 2000, Geneva: WHO, 29-
28.
go back to reference Burton A, Monasch R, Lautenbach B, Gacic-Dobo M, Neill M, Karimov R, Wolfson L, Jones G, Birmingham M: WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bull World Health Organ. 2009, 87: 535-541. 10.2471/BLT.08.053819.CrossRefPubMedPubMedCentral Burton A, Monasch R, Lautenbach B, Gacic-Dobo M, Neill M, Karimov R, Wolfson L, Jones G, Birmingham M: WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bull World Health Organ. 2009, 87: 535-541. 10.2471/BLT.08.053819.CrossRefPubMedPubMedCentral
30.
go back to reference Lim SS, Stein DB, Charrow A, Murray CJ: Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet. 2008, 372: 2031-2046. 10.1016/S0140-6736(08)61869-3.CrossRefPubMed Lim SS, Stein DB, Charrow A, Murray CJ: Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet. 2008, 372: 2031-2046. 10.1016/S0140-6736(08)61869-3.CrossRefPubMed
31.
go back to reference Griffiths UK, Hanvoravongchai P, Oliveira Cruz V, Mounier-Jack S, Balabanova D: A Toolkit for Assessing the Impacts of Measles Eradication Activities on Immunization Services and Health Systems at Country Level. 2010, London: London School of Hygeine and Tropical Medicine Griffiths UK, Hanvoravongchai P, Oliveira Cruz V, Mounier-Jack S, Balabanova D: A Toolkit for Assessing the Impacts of Measles Eradication Activities on Immunization Services and Health Systems at Country Level. 2010, London: London School of Hygeine and Tropical Medicine
32.
go back to reference Hirsch JS, Smith DJ, Phinney HM, Parikh S, Nathanson C: The Secret: Love, Marriage, and HIV. 2010, Nashville, TN: Vanderbilt University Press Hirsch JS, Smith DJ, Phinney HM, Parikh S, Nathanson C: The Secret: Love, Marriage, and HIV. 2010, Nashville, TN: Vanderbilt University Press
33.
go back to reference Homer JB, Hirsch GB: System dynamics modeling for public health: background and opportunities. Am J Public Health. 2006, 96: 452-458. 10.2105/AJPH.2005.062059.CrossRefPubMedPubMedCentral Homer JB, Hirsch GB: System dynamics modeling for public health: background and opportunities. Am J Public Health. 2006, 96: 452-458. 10.2105/AJPH.2005.062059.CrossRefPubMedPubMedCentral
Metadata
Title
Methods for evaluating the impact of vertical programs on health systems: protocol for a study on the impact of the global polio eradication initiative on strengthening routine immunization and primary health care
Authors
Svea Closser
Anat Rosenthal
Thomas Parris
Kenneth Maes
Judith Justice
Kelly Cox
Matthew A Luck
R Matthew Landis
John Grove
Pauley Tedoff
Linda Venczel
Peter Nsubuga
Jennifer Kuzara
Vanessa Neergheen
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2012
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-12-728

Other articles of this Issue 1/2012

BMC Public Health 1/2012 Go to the issue