Skip to main content
Top
Published in: Health Research Policy and Systems 1/2014

Open Access 01-12-2014 | Research

National health policy-makers’ views on the clarity and utility of Countdown to 2015 country profiles and reports: findings from two exploratory qualitative studies

Authors: Benjamin M Hunter, Jennifer H Requejo, Ian Pope, Bernadette Daelmans, Susan F Murray

Published in: Health Research Policy and Systems | Issue 1/2014

Login to get access

Abstract

Background

The use of sets of indicators to assess progress has become commonplace in the global health arena. Exploratory research has suggested that indicators used for global monitoring purposes can play a role in national policy-making, however, the mechanisms through which this occurs are poorly understood. This article reports findings from two qualitative studies that aimed to explore national policy-makers’ interpretation and use of indicators from country profiles and reports developed by Countdown to 2015.

Methods

An initial study aimed at exploring comprehension of Countdown data was conducted at the 2010 joint Women Deliver/Countdown conference. A second study was conducted at the 64th World Health Assembly in 2011, specifically targeting national policy-makers. Semi-structured interviews were carried out with 29 and 22 participants, respectively, at each event. Participants were asked about their understanding of specific graphs and indicators used or proposed for use in Countdown country profiles, and their perception of how such data can inform national policy-making. Responses were categorised using a framework analysis.

Results

Respondents in both studies acknowledged the importance of the profiles for tracking progress on key health indicators in and across countries, noting that they could be used to highlight changes in coverage, possible directions for future policy, for lobbying finance ministers to increase resources for health, and to stimulate competition between neighbouring or socioeconomically similar countries. However, some respondents raised questions about discrepancies between global estimates and data produced by national governments, and some struggled to understand the profile graphs shown in the absence of explanatory text. Some respondents reported that use of Countdown data in national policy-making was constrained by limited awareness of the initiative, insufficient detail in the country profiles to inform policy, and the absence of indicators felt to be more appropriate to their own country contexts.

Conclusions

The two studies emphasise the need for country consultations to ensure that national policy-makers understand how to interpret and use tools like the Countdown profile for planning purposes. They make clear the value of qualitative research for refining tools used to promote accountability, and the need for country level Countdown-like processes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Buse K: Addressing the theoretical, practical and ethical challenges inherent in prospective health policy analysis. Health Policy Plan. 2008, 23: 351-360.CrossRefPubMed Buse K: Addressing the theoretical, practical and ethical challenges inherent in prospective health policy analysis. Health Policy Plan. 2008, 23: 351-360.CrossRefPubMed
2.
go back to reference Gilson L, Raphaely N: The terrain of health policy analysis in low and middle income countries: a review of published literature 1994-2007. Health Policy Plan. 2008, 23: 294-307.CrossRefPubMedPubMedCentral Gilson L, Raphaely N: The terrain of health policy analysis in low and middle income countries: a review of published literature 1994-2007. Health Policy Plan. 2008, 23: 294-307.CrossRefPubMedPubMedCentral
3.
go back to reference Hanney SR, Gonzalez-Block MA, Buxton MJ, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1: 2-CrossRefPubMedPubMedCentral Hanney SR, Gonzalez-Block MA, Buxton MJ, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1: 2-CrossRefPubMedPubMedCentral
4.
go back to reference Vogel JP, Oxman AD, Glenton C, Rosenbaum S, Lewin S, Gulmezoglu AM, Souza JP: Policymakers’ and other stakeholders’ perceptions of key considerations for health system decisions and the presentation of evidence to inform those considerations: an international survey. Health Res Policy Syst. 2013, 11: 19-CrossRefPubMedPubMedCentral Vogel JP, Oxman AD, Glenton C, Rosenbaum S, Lewin S, Gulmezoglu AM, Souza JP: Policymakers’ and other stakeholders’ perceptions of key considerations for health system decisions and the presentation of evidence to inform those considerations: an international survey. Health Res Policy Syst. 2013, 11: 19-CrossRefPubMedPubMedCentral
5.
go back to reference Walt G, Gilson L: Reforming the health sector in developing countries: the central role of policy analysis. Health Policy Plan. 1994, 9: 353-370.CrossRefPubMed Walt G, Gilson L: Reforming the health sector in developing countries: the central role of policy analysis. Health Policy Plan. 1994, 9: 353-370.CrossRefPubMed
6.
go back to reference Bernier NF, Clavier C: Public health policy research: making the case for a political science approach. Health Promot Int. 2011, 26: 109-116.CrossRefPubMed Bernier NF, Clavier C: Public health policy research: making the case for a political science approach. Health Promot Int. 2011, 26: 109-116.CrossRefPubMed
8.
go back to reference Erasmus E, Gilson L: How to start thinking about investigating power in the organizational settings of policy implementation. Health Policy Plan. 2008, 23: 361-368.CrossRefPubMed Erasmus E, Gilson L: How to start thinking about investigating power in the organizational settings of policy implementation. Health Policy Plan. 2008, 23: 361-368.CrossRefPubMed
10.
go back to reference Shiffman J, Smith S: Generating Political Priority for Neonatal Mortality Reduction in Four Developing Countries. 2011, Washington DC: American University Shiffman J, Smith S: Generating Political Priority for Neonatal Mortality Reduction in Four Developing Countries. 2011, Washington DC: American University
11.
go back to reference Jonsson K: Translating Foreign Ideas into Domestic Practices: Pharmaceutical Policies in Laos and Vietnam. 2002, Lund: Lund University Jonsson K: Translating Foreign Ideas into Domestic Practices: Pharmaceutical Policies in Laos and Vietnam. 2002, Lund: Lund University
12.
go back to reference El-Jardali F, Ataya N, Jamal D, Jaafar M: A multi-faceted approach to promote knowledge translation platforms in eastern Mediterranean countries: climate for evidence-informed policy. Health Res Policy Syst. 2012, 10: 15-CrossRefPubMedPubMedCentral El-Jardali F, Ataya N, Jamal D, Jaafar M: A multi-faceted approach to promote knowledge translation platforms in eastern Mediterranean countries: climate for evidence-informed policy. Health Res Policy Syst. 2012, 10: 15-CrossRefPubMedPubMedCentral
13.
go back to reference Kasonde JM, Campbell S: Creating a Knowledge Translation Platform: nine lessons from the Zambia Forum for Health Research. Health Res Policy Syst. 2012, 10: 31-CrossRefPubMedPubMedCentral Kasonde JM, Campbell S: Creating a Knowledge Translation Platform: nine lessons from the Zambia Forum for Health Research. Health Res Policy Syst. 2012, 10: 31-CrossRefPubMedPubMedCentral
14.
go back to reference Innvaer S, Vist G, Trommald M, Oxman A: Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244.CrossRefPubMed Innvaer S, Vist G, Trommald M, Oxman A: Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244.CrossRefPubMed
15.
go back to reference Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl 1): 35-48.CrossRefPubMed Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl 1): 35-48.CrossRefPubMed
16.
go back to reference Rosenbaum SE, Glenton C, Oxman AD: Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol. 2010, 63: 620-626.CrossRefPubMed Rosenbaum SE, Glenton C, Oxman AD: Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol. 2010, 63: 620-626.CrossRefPubMed
17.
go back to reference (UNAIDS) JUNPoHA: Global Report: UNAIDS Report on the Global AIDS Epidemic 2012. 2012, Geneva: UNAIDS (UNAIDS) JUNPoHA: Global Report: UNAIDS Report on the Global AIDS Epidemic 2012. 2012, Geneva: UNAIDS
18.
go back to reference Countdown to 2015: Building a Future for Women and Children: The 2012 Report. 2012, Washington DC: World Health Organization Countdown to 2015: Building a Future for Women and Children: The 2012 Report. 2012, Washington DC: World Health Organization
19.
go back to reference Overseas Development Institute: Millennium Development Goals Report Card: Measuring Progress Across Countries. 2010, London: Overseas Development Institute Overseas Development Institute: Millennium Development Goals Report Card: Measuring Progress Across Countries. 2010, London: Overseas Development Institute
20.
go back to reference Bank W: Global Monitoring Report 2013: Rural-Urban Dynamics and the Millennium Development Goals. 2013, Washington DC: World BankCrossRef Bank W: Global Monitoring Report 2013: Rural-Urban Dynamics and the Millennium Development Goals. 2013, Washington DC: World BankCrossRef
21.
go back to reference World Health Organization: Trends in Maternal Mortality: 1990 to 2010. 2012, Geneva: World Health Organization World Health Organization: Trends in Maternal Mortality: 1990 to 2010. 2012, Geneva: World Health Organization
22.
go back to reference World Health Organization: World Health Statistics, 2013. 2013, Geneva: World Health Organization World Health Organization: World Health Statistics, 2013. 2013, Geneva: World Health Organization
23.
go back to reference Burchett HE, Mounier-Jack S, Griffiths UK, Biellik R, Ongolo-Zogo P, Chavez E, Sarma H, Uddin J, Konate M, Kitaw Y, Molla M, Wakasiaka S, Gilson L, Mills A: New vaccine adoption: qualitative study of national decision-making processes in seven low- and middle-income countries. Health Policy Plan. 2012, 27 (2): ii5-ii16.PubMed Burchett HE, Mounier-Jack S, Griffiths UK, Biellik R, Ongolo-Zogo P, Chavez E, Sarma H, Uddin J, Konate M, Kitaw Y, Molla M, Wakasiaka S, Gilson L, Mills A: New vaccine adoption: qualitative study of national decision-making processes in seven low- and middle-income countries. Health Policy Plan. 2012, 27 (2): ii5-ii16.PubMed
24.
go back to reference Albert MA, Fretheim A, Maiga D: Factors influencing the utilization of research findings by health policy-makers in a developing country: the selection of Mali’s essential medicines. Health Res Policy Syst. 2007, 5: 2-CrossRefPubMedPubMedCentral Albert MA, Fretheim A, Maiga D: Factors influencing the utilization of research findings by health policy-makers in a developing country: the selection of Mali’s essential medicines. Health Res Policy Syst. 2007, 5: 2-CrossRefPubMedPubMedCentral
25.
go back to reference Majdzadeh R, Yazdizadeh B, Nedjat S, Gholami J, Ahghari S: Strengthening evidence-based decision-making: is it possible without improving health system stewardship?. Health Policy Plan. 2012, 27: 499-504.CrossRefPubMed Majdzadeh R, Yazdizadeh B, Nedjat S, Gholami J, Ahghari S: Strengthening evidence-based decision-making: is it possible without improving health system stewardship?. Health Policy Plan. 2012, 27: 499-504.CrossRefPubMed
26.
go back to reference Biesma RG, Brugha R, Harmer A, Walsh A, Spicer N, Walt G: The effects of global health initiatives on country health systems: a review of the evidence from HIV/AIDS control. Health Policy Plan. 2009, 24: 239-252.CrossRefPubMedPubMedCentral Biesma RG, Brugha R, Harmer A, Walsh A, Spicer N, Walt G: The effects of global health initiatives on country health systems: a review of the evidence from HIV/AIDS control. Health Policy Plan. 2009, 24: 239-252.CrossRefPubMedPubMedCentral
27.
go back to reference Byskov J, Bloch P, Blystad A, Hurtig AK, Fylkesnes K, Kamuzora P, Kombe Y, Kvale G, Marchal B, Martin DK, Michelo C, Ndawi B, Ngulube TJ, Nyamongo I, Olsen OE, Onyango-Ouma W, Sandoy IF, Shayo EH, Silwamba G, Songstad NG, Tuba M: Accountable priority setting for trust in health systems–the need for research into a new approach for strengthening sustainable health action in developing countries. Health Res Policy Syst. 2009, 7: 23-CrossRefPubMedPubMedCentral Byskov J, Bloch P, Blystad A, Hurtig AK, Fylkesnes K, Kamuzora P, Kombe Y, Kvale G, Marchal B, Martin DK, Michelo C, Ndawi B, Ngulube TJ, Nyamongo I, Olsen OE, Onyango-Ouma W, Sandoy IF, Shayo EH, Silwamba G, Songstad NG, Tuba M: Accountable priority setting for trust in health systems–the need for research into a new approach for strengthening sustainable health action in developing countries. Health Res Policy Syst. 2009, 7: 23-CrossRefPubMedPubMedCentral
28.
go back to reference World Health Organization: The World Health Report, 2005: Make Every Mother and Child Count. 2005, Geneva: World Health OrganizationCrossRef World Health Organization: The World Health Report, 2005: Make Every Mother and Child Count. 2005, Geneva: World Health OrganizationCrossRef
29.
go back to reference World Health Organization: The World Health Report, 2000: Health Systems: Improving Performance. 2000, Geneva: World Health Organization World Health Organization: The World Health Report, 2000: Health Systems: Improving Performance. 2000, Geneva: World Health Organization
30.
go back to reference Frenk J: The World Health Report 2000: expanding the horizon of health system performance. Health Policy Plan. 2010, 25: 343-345.CrossRefPubMed Frenk J: The World Health Report 2000: expanding the horizon of health system performance. Health Policy Plan. 2010, 25: 343-345.CrossRefPubMed
31.
32.
go back to reference Brundtland G, Frenk J, Murray C: WHO assessment of health systems performance. Lancet. 2003, 361: 2155-2155.CrossRefPubMed Brundtland G, Frenk J, Murray C: WHO assessment of health systems performance. Lancet. 2003, 361: 2155-2155.CrossRefPubMed
33.
go back to reference McIntyre D: WHR 2000 to WHR 2010: what progress in health care financing?. Health Policy Plan. 2010, 25: 349-351.CrossRefPubMed McIntyre D: WHR 2000 to WHR 2010: what progress in health care financing?. Health Policy Plan. 2010, 25: 349-351.CrossRefPubMed
34.
go back to reference Bryce J, Terreri N, Victora CG, Mason E, Daelmans B, Bhutta ZA, Bustreo F, Songane F, Salama P, Wardlaw T: Countdown to 2015: tracking intervention coverage for child survival. Lancet. 2006, 368: 1067-1076.CrossRefPubMed Bryce J, Terreri N, Victora CG, Mason E, Daelmans B, Bhutta ZA, Bustreo F, Songane F, Salama P, Wardlaw T: Countdown to 2015: tracking intervention coverage for child survival. Lancet. 2006, 368: 1067-1076.CrossRefPubMed
35.
go back to reference Barros AJD, Ronsmans C, Axelson H, Loaiza E, Bertoldi AD, França GVA, Bryce J, Boerma JT, Victora CG: Equity in maternal, newborn, and child health interventions in Countdown to 2015: a retrospective review of survey data from 54 countries. Lancet. 2012, 379: 1225-1233.CrossRefPubMed Barros AJD, Ronsmans C, Axelson H, Loaiza E, Bertoldi AD, França GVA, Bryce J, Boerma JT, Victora CG: Equity in maternal, newborn, and child health interventions in Countdown to 2015: a retrospective review of survey data from 54 countries. Lancet. 2012, 379: 1225-1233.CrossRefPubMed
36.
go back to reference Victora CG, Barros AJD, Axelson H, Bhutta ZA, Chopra M, França GVA, Kerber K, Kirkwood BR, Newby H, Ronsmans C, Boerma JT: How changes in coverage affect equity in maternal and child health interventions in 35 Countdown to 2015 countries: an analysis of national surveys. Lancet. 2012, 380: 1149-1156.CrossRefPubMed Victora CG, Barros AJD, Axelson H, Bhutta ZA, Chopra M, França GVA, Kerber K, Kirkwood BR, Newby H, Ronsmans C, Boerma JT: How changes in coverage affect equity in maternal and child health interventions in 35 Countdown to 2015 countries: an analysis of national surveys. Lancet. 2012, 380: 1149-1156.CrossRefPubMed
37.
go back to reference Hsu J, Pitt C, Greco G, Berman P, Mills A: Countdown to 2015: changes in official development assistance to maternal, newborn, and child health in 2009–10, and assessment of progress since 2003. Lancet. 2012, 380: 1157-1168.CrossRefPubMed Hsu J, Pitt C, Greco G, Berman P, Mills A: Countdown to 2015: changes in official development assistance to maternal, newborn, and child health in 2009–10, and assessment of progress since 2003. Lancet. 2012, 380: 1157-1168.CrossRefPubMed
38.
go back to reference Countdown to 2015: Countdown to 2015 Decade Report (2000–2010): Taking Stock of Maternal, Newborn and Child Survival. 2010, Geneva: World Health Organization Countdown to 2015: Countdown to 2015 Decade Report (2000–2010): Taking Stock of Maternal, Newborn and Child Survival. 2010, Geneva: World Health Organization
39.
go back to reference Denzin NK, Lincoln Y: The Sage Handbook of Qualitative Research. 2011, Los Angeles: Sage Denzin NK, Lincoln Y: The Sage Handbook of Qualitative Research. 2011, Los Angeles: Sage
40.
go back to reference Silverman D: Qualitative Research: Issues of Theory, Method and Practice. 2011, London: Sage Silverman D: Qualitative Research: Issues of Theory, Method and Practice. 2011, London: Sage
42.
go back to reference Creswell JW, Plano Clark VL: Designing and Conducting Mixed Methods Research. 2011, London: Sage Creswell JW, Plano Clark VL: Designing and Conducting Mixed Methods Research. 2011, London: Sage
43.
go back to reference Amouzou A, Habi O, Bensaïd K: Reduction in child mortality in Niger: a Countdown to 2015 country case study. Lancet. 2012, 380: 1169-1178.CrossRefPubMed Amouzou A, Habi O, Bensaïd K: Reduction in child mortality in Niger: a Countdown to 2015 country case study. Lancet. 2012, 380: 1169-1178.CrossRefPubMed
44.
go back to reference El Arifeen S, Hill K, Ahsan KZ, Jamil K, Nahar Q, Streatfield PK: Maternal mortality in Bangladesh: a Countdown to 2015 country case study. Lancet. 2014, In press El Arifeen S, Hill K, Ahsan KZ, Jamil K, Nahar Q, Streatfield PK: Maternal mortality in Bangladesh: a Countdown to 2015 country case study. Lancet. 2014, In press
45.
go back to reference Requejo JH, Newby H, Bryce J: Measuring coverage in MNCH: challenges and opportunities in the selection of coverage indicators for global monitoring. PLoS Med. 2013, 10: e1001416-CrossRefPubMedPubMedCentral Requejo JH, Newby H, Bryce J: Measuring coverage in MNCH: challenges and opportunities in the selection of coverage indicators for global monitoring. PLoS Med. 2013, 10: e1001416-CrossRefPubMedPubMedCentral
46.
go back to reference Gordon A: Q & ASAP - After the MDGs: Thomas Pogge see some pitfalls in first official recommendations for Millennium Development Goals replacement effort. 2013, Academics Stand Against Poverty: New Haven Gordon A: Q & ASAP - After the MDGs: Thomas Pogge see some pitfalls in first official recommendations for Millennium Development Goals replacement effort. 2013, Academics Stand Against Poverty: New Haven
Metadata
Title
National health policy-makers’ views on the clarity and utility of Countdown to 2015 country profiles and reports: findings from two exploratory qualitative studies
Authors
Benjamin M Hunter
Jennifer H Requejo
Ian Pope
Bernadette Daelmans
Susan F Murray
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2014
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/1478-4505-12-40

Other articles of this Issue 1/2014

Health Research Policy and Systems 1/2014 Go to the issue