Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Exploring implementation practices in results-based financing: the case of the verification in Benin

Authors: Matthieu Antony, Maria Paola Bertone, Olivier Barthes

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Results-based financing (RBF) has been introduced in many countries across Africa and a growing literature is building around the assessment of their impact. These studies are usually quantitative and often silent on the paths and processes through which results are achieved and on the wider health system effects of RBF. To address this gap, our study aims at exploring the implementation of an RBF pilot in Benin, focusing on the verification of results.

Methods

The study is based on action research carried out by authors involved in the pilot as part of the agency supporting the RBF implementation in Benin. While our participant observation and operational collaboration with project’s stakeholders informed the study, the analysis is mostly based on quantitative and qualitative secondary data, collected throughout the project’s implementation and documentation processes. Data include project documents, reports and budgets, RBF data on service outputs and on the outcome of the verification, daily activity timesheets of the technical assistants in the districts, as well as focus groups with Community-based Organizations and informal interviews with technical assistants and district medical officers.

Results

Our analysis focuses on the actual practices of quantitative, qualitative and community verification. Results show that the verification processes are complex, costly and time-consuming, and in practice they end up differing from what designed originally. We explore the consequences of this on the operation of the scheme, on its potential to generate the envisaged change. We find, for example, that the time taken up by verification procedures limits the time available for data analysis and feedback to facility staff, thus limiting the potential to improve service delivery. Verification challenges also result in delays in bonus payment, which delink effort and reward. Additionally, the limited integration of the verification activities of district teams with their routine tasks causes a further verticalization of the health system.

Conclusions

Our results highlight the potential disconnect between the theory of change behind RBF and the actual scheme’s implementation. The implications are relevant at methodological level, stressing the importance of analyzing implementation processes to fully understand results, as well as at operational level, pointing to the need to carefully adapt the design of RBF schemes (including verification and other key functions) to the context and to allow room to iteratively modify it during implementation. They also question whether the rationale for thorough and costly verification is justified, or rather adaptations are possible.
Literature
1.
go back to reference Musgrove P. Financial and other rewards for good performance or results: a guided tour of concepts and terms and a short glossary. Washington: World Bank background Brief; 2011. Musgrove P. Financial and other rewards for good performance or results: a guided tour of concepts and terms and a short glossary. Washington: World Bank background Brief; 2011.
2.
go back to reference Meessen B, Soucat A, Sekabaraga C. Performance-based financing: just a donor fad or a catalyst towards comprehensive health-care reform? Bull World Health Organ. 2011;89:153–6.CrossRefPubMed Meessen B, Soucat A, Sekabaraga C. Performance-based financing: just a donor fad or a catalyst towards comprehensive health-care reform? Bull World Health Organ. 2011;89:153–6.CrossRefPubMed
3.
go back to reference Kalk A, Paul FA, Grabosch E. “Paying for performance” in Rwanda: does it pay off? Trop Med Int Heal. 2010;15:182–90.CrossRef Kalk A, Paul FA, Grabosch E. “Paying for performance” in Rwanda: does it pay off? Trop Med Int Heal. 2010;15:182–90.CrossRef
4.
go back to reference Ireland M, Paul E, Dujardin B. Can performance-based financing be used to reform health systems in developing countries? Bull World Health Organ. 2011;89:695–8.CrossRefPubMedPubMedCentral Ireland M, Paul E, Dujardin B. Can performance-based financing be used to reform health systems in developing countries? Bull World Health Organ. 2011;89:695–8.CrossRefPubMedPubMedCentral
5.
go back to reference Witter S, Fretheim A, Kessy F, Lindahl A. Paying for performance to improve the delivery of health interventions in low- and middle-income countries (Review). Cochrane Collab. 2012;(3). Witter S, Fretheim A, Kessy F, Lindahl A. Paying for performance to improve the delivery of health interventions in low- and middle-income countries (Review). Cochrane Collab. 2012;(3).
6.
go back to reference Basinga P, Gertler PJ, Binagwaho A, Soucat AL, Sturdy J, Vermeersch CM. Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation. Lancet. 2011;377:1421–8.CrossRefPubMed Basinga P, Gertler PJ, Binagwaho A, Soucat AL, Sturdy J, Vermeersch CM. Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation. Lancet. 2011;377:1421–8.CrossRefPubMed
7.
go back to reference Falisse J-B, Ndayishimiye J, Kamenyero V, Bossuyt M. Performance-based financing in the context of selective free health-care: an evaluation of its effects on the use of primary health-care services in Burundi using routine data. Health Policy Plan. 2014;30:1251–60.CrossRefPubMed Falisse J-B, Ndayishimiye J, Kamenyero V, Bossuyt M. Performance-based financing in the context of selective free health-care: an evaluation of its effects on the use of primary health-care services in Burundi using routine data. Health Policy Plan. 2014;30:1251–60.CrossRefPubMed
8.
go back to reference Bonfrer I, Van de Poel E, Van Doorslaer E. The effects of performance incentives on the utilization and quality of maternal and child care in Burundi. Soc Sci Med. 2014;123:96–104.CrossRefPubMed Bonfrer I, Van de Poel E, Van Doorslaer E. The effects of performance incentives on the utilization and quality of maternal and child care in Burundi. Soc Sci Med. 2014;123:96–104.CrossRefPubMed
9.
go back to reference Huillery E, Seban J. Financial incentives are counterproductive in non-profit sectors: evidence from a health experiment. Paris: Science Po, Department of Economics - Working Paper; 2015. Huillery E, Seban J. Financial incentives are counterproductive in non-profit sectors: evidence from a health experiment. Paris: Science Po, Department of Economics - Working Paper; 2015.
10.
go back to reference Binyaruka P, Patouillard E, Powell-Jackson T, Greco G, Maestad O, Borghi J. Effect of paying for performance on utilisation, quality, and user costs of health services in Tanzania: a controlled before and after study. PLoS ONE. 2015;10:8.CrossRef Binyaruka P, Patouillard E, Powell-Jackson T, Greco G, Maestad O, Borghi J. Effect of paying for performance on utilisation, quality, and user costs of health services in Tanzania: a controlled before and after study. PLoS ONE. 2015;10:8.CrossRef
12.
go back to reference Ssengooba F, McPake B, Palmer N. Why performance-based contracting failed in Uganda--an “open-box” evaluation of a complex health system intervention. Soc Sci Med. 2012;75:377–83.CrossRefPubMed Ssengooba F, McPake B, Palmer N. Why performance-based contracting failed in Uganda--an “open-box” evaluation of a complex health system intervention. Soc Sci Med. 2012;75:377–83.CrossRefPubMed
13.
go back to reference Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed
14.
go back to reference Luoto J, Shekelle PG, Maglione MA, Johnsen B, Perry T. Reporting of context and implementation in studies of global health interventions: a pilot study. Implement Sci. 2014;9:57.CrossRefPubMedPubMedCentral Luoto J, Shekelle PG, Maglione MA, Johnsen B, Perry T. Reporting of context and implementation in studies of global health interventions: a pilot study. Implement Sci. 2014;9:57.CrossRefPubMedPubMedCentral
15.
go back to reference Renmans D, Holvoet N, Orach CG, Criel B. Opening the “black box” of performance-based financing in low- and lower middle-income countries: a review of the literature. Heal Policy Plan. 2016;31(9):1297–309. Advanced Access.CrossRef Renmans D, Holvoet N, Orach CG, Criel B. Opening the “black box” of performance-based financing in low- and lower middle-income countries: a review of the literature. Heal Policy Plan. 2016;31(9):1297–309. Advanced Access.CrossRef
16.
go back to reference Fritsche G, Soeters R, Meessen B. Performance-Based Financing Toolkit. Washington, DC: World Bank; 2014.CrossRef Fritsche G, Soeters R, Meessen B. Performance-Based Financing Toolkit. Washington, DC: World Bank; 2014.CrossRef
17.
go back to reference Bertone MP, Meessen B. Studying the link between institutions and health system performance: a framework and an illustration with the analysis of two performance-based financing schemes in Burundi. Health Policy Plan. 2013;28:847–57.CrossRefPubMed Bertone MP, Meessen B. Studying the link between institutions and health system performance: a framework and an illustration with the analysis of two performance-based financing schemes in Burundi. Health Policy Plan. 2013;28:847–57.CrossRefPubMed
18.
go back to reference Soeters R, Habineza C, Peerenboom PB. Performance-based financing and changing the district health system: Experience from Rwanda. Bull World Health Organ. 2006;84:884–9.PubMedPubMedCentral Soeters R, Habineza C, Peerenboom PB. Performance-based financing and changing the district health system: Experience from Rwanda. Bull World Health Organ. 2006;84:884–9.PubMedPubMedCentral
19.
go back to reference Renaud A. Verification of Performance in Results-Based Financing (RBF): The Case of the Burundi. Washington, DC: World Bank - HNP Discussion Paper; 2013. Renaud A. Verification of Performance in Results-Based Financing (RBF): The Case of the Burundi. Washington, DC: World Bank - HNP Discussion Paper; 2013.
20.
go back to reference Borghi J, Little R, Binyaruka P, Patouillard E, Kuwawenaruwa A. In Tanzania, the many costs of pay-for-performance leave open to debate whether the strategy is cost-effective. Health Aff. 2015;34:406–14.CrossRef Borghi J, Little R, Binyaruka P, Patouillard E, Kuwawenaruwa A. In Tanzania, the many costs of pay-for-performance leave open to debate whether the strategy is cost-effective. Health Aff. 2015;34:406–14.CrossRef
22.
go back to reference AEDES/Scenafrik. Mission D’appui À L’utilisation Des Credit FBR et À L’autonomie de Formations Sanitaires. Cotonou; 2015. AEDES/Scenafrik. Mission D’appui À L’utilisation Des Credit FBR et À L’autonomie de Formations Sanitaires. Cotonou; 2015.
23.
go back to reference MoH. Document de Cadrage Du FBR Au Bénin. Cotonou: Ministere de la Santé Publique; 2011. MoH. Document de Cadrage Du FBR Au Bénin. Cotonou: Ministere de la Santé Publique; 2011.
24.
go back to reference Meyer J. Action research. In: N F, editor. Studying the organisation and delivery of health services: research methods. London: Routledge; 2001. Meyer J. Action research. In: N F, editor. Studying the organisation and delivery of health services: research methods. London: Routledge; 2001.
25.
go back to reference Gilson L. Health Policy and Systems Research. A Methodology Reader. Geneva: Alliance for Health Policy and Systems Research & World Health Organization; 2012. Gilson L. Health Policy and Systems Research. A Methodology Reader. Geneva: Alliance for Health Policy and Systems Research & World Health Organization; 2012.
26.
go back to reference Ridde V. “The problem of the worst-off is dealt with after all other issues”: the equity and health policy implementation gap in Burkina Faso. Soc Sci Med. 2008;66:1368–78.CrossRefPubMed Ridde V. “The problem of the worst-off is dealt with after all other issues”: the equity and health policy implementation gap in Burkina Faso. Soc Sci Med. 2008;66:1368–78.CrossRefPubMed
27.
go back to reference Walt G, Shiffman J, Schneider H, Murray SF, Brugha R, Gilson L. “Doing” health policy analysis: methodological and conceptual reflections and challenges. Health Policy Plan. 2008;23:308–17.CrossRefPubMedPubMedCentral Walt G, Shiffman J, Schneider H, Murray SF, Brugha R, Gilson L. “Doing” health policy analysis: methodological and conceptual reflections and challenges. Health Policy Plan. 2008;23:308–17.CrossRefPubMedPubMedCentral
28.
go back to reference Bertone MP, Lagarde M, Witter S. Performance-Based Financing in the context of the complex remuneration of health workers: findings from a mixed-method study in rural Sierra Leone. BMC Health Serv Res. 2016;16:286.CrossRefPubMedPubMedCentral Bertone MP, Lagarde M, Witter S. Performance-Based Financing in the context of the complex remuneration of health workers: findings from a mixed-method study in rural Sierra Leone. BMC Health Serv Res. 2016;16:286.CrossRefPubMedPubMedCentral
29.
go back to reference Bhatnagar A, George AS. Motivating health workers up to a limit: partial effects of performance-based financing on working environments in Nigeria. Heal Policy Plan . 2016;31(7):868–77. Advanced Access.CrossRef Bhatnagar A, George AS. Motivating health workers up to a limit: partial effects of performance-based financing on working environments in Nigeria. Heal Policy Plan . 2016;31(7):868–77. Advanced Access.CrossRef
30.
go back to reference Ogundeji YK, Jackson C, Sheldon T, Olubajo O, Ihebuzor N. Pay for performance in Nigeria: the influence of context and implementation on results. Heal Policy Plan. 2016;31(8):955–63. Advanced Access.CrossRef Ogundeji YK, Jackson C, Sheldon T, Olubajo O, Ihebuzor N. Pay for performance in Nigeria: the influence of context and implementation on results. Heal Policy Plan. 2016;31(8):955–63. Advanced Access.CrossRef
32.
go back to reference Falisse J-B, Meessen B, Ndayishimiye J, Bossuyt M. Community participation and voice mechanisms under performance-based financing schemes in Burundi. Trop Med Int Heal. 2012;17:674–82.CrossRef Falisse J-B, Meessen B, Ndayishimiye J, Bossuyt M. Community participation and voice mechanisms under performance-based financing schemes in Burundi. Trop Med Int Heal. 2012;17:674–82.CrossRef
33.
go back to reference Naimoli JF, Vergeer P. Verification at a Glance. A Series of Snapshots of Experiences in Verifying Performance Linked to Financial Incentives for Results-Based Financing (RBF) Programs from Selected Countries. Washington, DC: World Bank; 2010. Naimoli JF, Vergeer P. Verification at a Glance. A Series of Snapshots of Experiences in Verifying Performance Linked to Financial Incentives for Results-Based Financing (RBF) Programs from Selected Countries. Washington, DC: World Bank; 2010.
34.
go back to reference Vergeer P, Hashemi T, Sabignoso M, Basenya O, Mugeni C, Vushoma E, Sisimayi C: Verification of Results. Findings and Recommendations from a Cross-Case Analysis. World Bank - presentation at the Annual Results and Impact Evaluation Workshop for RBF; 2014. Vergeer P, Hashemi T, Sabignoso M, Basenya O, Mugeni C, Vushoma E, Sisimayi C: Verification of Results. Findings and Recommendations from a Cross-Case Analysis. World Bank - presentation at the Annual Results and Impact Evaluation Workshop for RBF; 2014.
35.
go back to reference Lagarde M, Wright M, Nossiter J, Mays N. Challenges of payment-for-performance in health care and Other Public Services – Design, Implementation and Evaluation. London: London School of Hygiene and Tropical Medicine - Policy Innovation Research Unit; 2013. Lagarde M, Wright M, Nossiter J, Mays N. Challenges of payment-for-performance in health care and Other Public Services – Design, Implementation and Evaluation. London: London School of Hygiene and Tropical Medicine - Policy Innovation Research Unit; 2013.
36.
go back to reference Deaton A. Randomization in the Tropics, and the Search for the Elusive Keys to Economic Development. NBER Working Paper No. 14690; 2009. Deaton A. Randomization in the Tropics, and the Search for the Elusive Keys to Economic Development. NBER Working Paper No. 14690; 2009.
Metadata
Title
Exploring implementation practices in results-based financing: the case of the verification in Benin
Authors
Matthieu Antony
Maria Paola Bertone
Olivier Barthes
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2148-9

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue