Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

Creating spaces for dialogue: a cluster-randomized evaluation of CARE’s Community Score Card on health governance outcomes

Authors: Sara Gullo, Anne Sebert Kuhlmann, Christine Galavotti, Thumbiko Msiska, C. Nathan Marti, Philip Hastings

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

Social accountability interventions such as CARE’s Community Score Card© show promise for improving sexual, reproductive, and maternal health outcomes. A key component of the intervention is creation of spaces where community members, healthcare workers, and district officials can safely interact and collaborate to improve health-related outcomes. Here, we evaluate the intervention’s effect on governance constructs such as power sharing and equity that are central to our theory of change.

Methods

We randomly assigned ten matched pairs of communities to intervention and control arms, administering endline surveys to women in each arm who had given birth in the last 12 months. Forty-six governance items were reduced by factor analysis into eight underlying scales. We evaluated the intervention’s impact on these constructs using local average treatment effect estimates.

Results

Among intervention-area women who reported a community meeting, we further evaluated the influence of the governance constructs on health-related outcomes: home visit from a community health worker, modern family planning, and satisfaction with health services. A significantly greater proportion of intervention-area women compared to control reported the existence of community groups that provide and facilitate negotiated space between community members and healthcare workers (p = .003). Several governance constructs were positively associated with the health-related outcomes. Further, active participation in the intervention was also positively associated with several governance constructs.

Conclusions

CARE’s Community Score Card© facilitated the creation and claiming of effective and inclusive negotiated spaces in which community members and healthcare workers could vocalize service delivery issues and prioritize actions for improvement. We argue that reliable measurement of governance concepts such as power sharing, equity and quality of negotiated space, collective efficacy, and mutual responsibility will enhance our ability to evaluate social accountability interventions and understand the processes by which they affect change.
Footnotes
1
“Health Workers have influence over decisions about the provider of health services”
 
2
“Meetings in which — Information about health services was shared?” and “Community and health care providers together — Mobilized resources, including in-kind and financial, to improve health services?”
 
3
“Satisfied with the amount of influence of Health Workers not included in scale scores”
 
Literature
3.
go back to reference Gaventa J, McGee R. The impact of transparency and accountability initiatives. Development Policy Review. 2013;31:s3–s28.CrossRef Gaventa J, McGee R. The impact of transparency and accountability initiatives. Development Policy Review. 2013;31:s3–s28.CrossRef
4.
go back to reference Joshi A. Do they work? Assessing the impact of transparency and accountability initiatives in service delivery. Development Policy Review. 2013;31:s29–48.CrossRef Joshi A. Do they work? Assessing the impact of transparency and accountability initiatives in service delivery. Development Policy Review. 2013;31:s29–48.CrossRef
5.
go back to reference Sebert Kuhlmann A, Gullo S, Galavotti C, Grant C, Cavatore M, Posnock S. Women’s and health workers’ voices in open, inclusive communities and effective spaces (VOICES): measuring governance outcomes in reproductive and maternal health Programmes. Development Policy Review. 2017;35:289–311.CrossRef Sebert Kuhlmann A, Gullo S, Galavotti C, Grant C, Cavatore M, Posnock S. Women’s and health workers’ voices in open, inclusive communities and effective spaces (VOICES): measuring governance outcomes in reproductive and maternal health Programmes. Development Policy Review. 2017;35:289–311.CrossRef
6.
go back to reference Gaventa J. Towards participatory governance: assessing the transformative possibilities. In: Hickey S, Mohan G, editors. Participation: from tyranny to transformation. London: Zed Books; 2004. p. 25–41. Gaventa J. Towards participatory governance: assessing the transformative possibilities. In: Hickey S, Mohan G, editors. Participation: from tyranny to transformation. London: Zed Books; 2004. p. 25–41.
8.
go back to reference Sibamo EL, Berheto TM. Community satisfaction with the urban health extension service in South Ethiopia and associated factors. BMC Health Serv Res. 2015;15(1):1.CrossRef Sibamo EL, Berheto TM. Community satisfaction with the urban health extension service in South Ethiopia and associated factors. BMC Health Serv Res. 2015;15(1):1.CrossRef
9.
go back to reference Jallow IK, Chou YJ, Liu TL, Huang N. Women's perception of antenatal care services in public and private clinics in the Gambia. Int J Qual Health Care. 2012;24(6):595–600.CrossRef Jallow IK, Chou YJ, Liu TL, Huang N. Women's perception of antenatal care services in public and private clinics in the Gambia. Int J Qual Health Care. 2012;24(6):595–600.CrossRef
10.
go back to reference d'Ambruoso L, Abbey M, Hussein J. Please understand when I cry out in pain: women's accounts of maternity services during labour and delivery in Ghana. BMC Public Health. 2005;5(1):1.CrossRef d'Ambruoso L, Abbey M, Hussein J. Please understand when I cry out in pain: women's accounts of maternity services during labour and delivery in Ghana. BMC Public Health. 2005;5(1):1.CrossRef
11.
go back to reference Mohan D, Gupta S, LeFevre A, Bazant E, Killewo J, Baqui AH. Determinants of postnatal care use at health facilities in rural Tanzania: multilevel analysis of a household survey. BMC pregnancy and childbirth. 2015;15(1):1.CrossRef Mohan D, Gupta S, LeFevre A, Bazant E, Killewo J, Baqui AH. Determinants of postnatal care use at health facilities in rural Tanzania: multilevel analysis of a household survey. BMC pregnancy and childbirth. 2015;15(1):1.CrossRef
12.
go back to reference Gaventa J, Barrett G. Mapping the outcomes of citizen engagement. World Dev. 2012;40:2399–410.CrossRef Gaventa J, Barrett G. Mapping the outcomes of citizen engagement. World Dev. 2012;40:2399–410.CrossRef
13.
go back to reference Murthy RK, Klugman B. Service accountability and community participation in the context of health sector reforms in Asia: implications for sexual and reproductive health services. Health Policy Plan. 2004;19:i78–86.CrossRef Murthy RK, Klugman B. Service accountability and community participation in the context of health sector reforms in Asia: implications for sexual and reproductive health services. Health Policy Plan. 2004;19:i78–86.CrossRef
17.
go back to reference Gullo S, Galavotti C, Sebert Kuhlmann A, Msiska T, Hastings P, Marti N. Raising the score: evidence from a cluster-randomized trial in Malawi on the effects of a social accountability intervention on reproductive health-related outcomes. PLoS One. 2017;12(2):e0171316.CrossRef Gullo S, Galavotti C, Sebert Kuhlmann A, Msiska T, Hastings P, Marti N. Raising the score: evidence from a cluster-randomized trial in Malawi on the effects of a social accountability intervention on reproductive health-related outcomes. PLoS One. 2017;12(2):e0171316.CrossRef
20.
go back to reference Angrist JD, Pischke J. Mostly harmless econometrics: an empiricist's companion. Princeton, NJ: Princeton University Press; 2009. Angrist JD, Pischke J. Mostly harmless econometrics: an empiricist's companion. Princeton, NJ: Princeton University Press; 2009.
21.
go back to reference Angrist JD. Instrumental variables methods in experimental criminological research: what, why and how. Journal of Experimental Criminology. 2006;2:23–44.CrossRef Angrist JD. Instrumental variables methods in experimental criminological research: what, why and how. Journal of Experimental Criminology. 2006;2:23–44.CrossRef
22.
go back to reference Björkman M, Svensson J. Power to the people: evidence from a randomized field experiment of a community-based monitoring project. Q J Econ. 2009;124(2):735–69.CrossRef Björkman M, Svensson J. Power to the people: evidence from a randomized field experiment of a community-based monitoring project. Q J Econ. 2009;124(2):735–69.CrossRef
23.
go back to reference Zeitlin A, Bategeka L, Guloba M, Kasirye I, Mugisha F. Management and motivation in Ugandan primary schools: impact evaluation final report. Center for the Studies of African Economies 2011. Zeitlin A, Bategeka L, Guloba M, Kasirye I, Mugisha F. Management and motivation in Ugandan primary schools: impact evaluation final report. Center for the Studies of African Economies 2011.
24.
go back to reference Blankenship KM, West BS, Kershaw TS, Biradavolu MR. Power, community mobilization, and condom use practices among female sex workers in Andhra Pradesh, India. AIDS. 2008;22:S109–16.CrossRef Blankenship KM, West BS, Kershaw TS, Biradavolu MR. Power, community mobilization, and condom use practices among female sex workers in Andhra Pradesh, India. AIDS. 2008;22:S109–16.CrossRef
25.
go back to reference Romero L, Wallerstein N, Lucero J, Fredine HG, Keefe J, O'Connell J. Woman to woman: coming together for positive change-using empowerment and popular education to prevent HIV in women. AIDS Education & Prevention. 2006;18(5):390–405.CrossRef Romero L, Wallerstein N, Lucero J, Fredine HG, Keefe J, O'Connell J. Woman to woman: coming together for positive change-using empowerment and popular education to prevent HIV in women. AIDS Education & Prevention. 2006;18(5):390–405.CrossRef
27.
go back to reference Thom DH, Kravitz RL, Bell RA, Krupat E, Azari R. Patient trust in the physician: relationship to patient requests. Fam Pract. 2002;19(5):476–83.CrossRef Thom DH, Kravitz RL, Bell RA, Krupat E, Azari R. Patient trust in the physician: relationship to patient requests. Fam Pract. 2002;19(5):476–83.CrossRef
28.
go back to reference Thom DH, Hall MA, Pawlson LG. Measuring patients’ trust in physicians when assessing quality of care. Health Aff. 2004;23(4):124–32.CrossRef Thom DH, Hall MA, Pawlson LG. Measuring patients’ trust in physicians when assessing quality of care. Health Aff. 2004;23(4):124–32.CrossRef
29.
go back to reference Berlan D, Shiffman J. Holding health providers in developing countries accountable to consumers: a synthesis of relevant scholarship. Health Policy Plan. 2011;27:271–80.CrossRef Berlan D, Shiffman J. Holding health providers in developing countries accountable to consumers: a synthesis of relevant scholarship. Health Policy Plan. 2011;27:271–80.CrossRef
30.
go back to reference Mehta S. Service quality as predicator of patient satisfaction a study of the health care sector. J Health Manag. 2011;13(2):211–29.CrossRef Mehta S. Service quality as predicator of patient satisfaction a study of the health care sector. J Health Manag. 2011;13(2):211–29.CrossRef
31.
go back to reference Platonova EA, Kennedy KN, Shewchuk RM. Understanding patient satisfaction, trust, and loyalty to primary care physicians. Med Care Res Rev. 2008;65(6):696–712.CrossRef Platonova EA, Kennedy KN, Shewchuk RM. Understanding patient satisfaction, trust, and loyalty to primary care physicians. Med Care Res Rev. 2008;65(6):696–712.CrossRef
Metadata
Title
Creating spaces for dialogue: a cluster-randomized evaluation of CARE’s Community Score Card on health governance outcomes
Authors
Sara Gullo
Anne Sebert Kuhlmann
Christine Galavotti
Thumbiko Msiska
C. Nathan Marti
Philip Hastings
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3651-3

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue