Skip to main content
Top
Published in: International Journal for Equity in Health 1/2020

01-12-2020 | Contraception | Research

Adaptation and validation of social accountability measures in the context of contraceptive services in Ghana and Tanzania

Authors: Victoria Boydell, Petrus S. Steyn, Joanna Paula Cordero, Ndema Habib, My Huong Nguyen, Dela Nai, Donat Shamba

Published in: International Journal for Equity in Health | Issue 1/2020

Login to get access

Abstract

Background

Changes in the values, attitudes, and interactions of both service users and health care providers are central to social accountability processes in reproductive health. However, there is little consensus on how best to measure these latent changes. This paper reports on the adaptation and validation of measures that capture these changes in Tanzania and Ghana.

Methods

The CaPSAI theory of change determined the dimensions of the measure, and we adapted existing items for the survey items. Trained data collectors used a survey to collect data from 752 women in Tanzania and 750 women in Ghana attending contraceptive services. We used reliability analysis, exploratory, and confirmatory factor analysis to assess the validity and reliability of these measures in each country.

Results

The measure has high construct validity and reliability in both countries. We identified several subscales in both countries, 10 subscales in Tanzania, and 11 subscales in Ghana. Many of the domains and items were shared across both settings.

Conclusion

The study suggests that the multi-dimensional scales have high construct validity and reliability in both countries. Though there were differences in the two country contexts and in items and scales, there was convergence in the analysis that suggests that this measure may be relevant in different settings and should be validated in new settings.

Trial registration

Literature
1.
go back to reference Abdel-Tawab N, RamaRao S. Do improvements in client-provider interaction increase contraceptive con- tinuation? Unraveling the puzzle. Patient Educ Couns. 2010;81(3):381–7.CrossRefPubMed Abdel-Tawab N, RamaRao S. Do improvements in client-provider interaction increase contraceptive con- tinuation? Unraveling the puzzle. Patient Educ Couns. 2010;81(3):381–7.CrossRefPubMed
3.
go back to reference Ali MM, Cleland J, Shah IH. Causes and consequences of contraceptive discontinuation: evidence for 60 demographic and health surveys. Geneva: World Health Organization; 2012. Ali MM, Cleland J, Shah IH. Causes and consequences of contraceptive discontinuation: evidence for 60 demographic and health surveys. Geneva: World Health Organization; 2012.
4.
go back to reference Anthoine E, Moret L, Regnault A, Sbille V, Hardouin J. Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes. 2014;12:176.CrossRefPubMed Anthoine E, Moret L, Regnault A, Sbille V, Hardouin J. Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes. 2014;12:176.CrossRefPubMed
5.
go back to reference Björkman M, Svensson J. Power to the people: evidence from a randomized field experiment of a community-based monitoring project. Q J Econ. 2009;124(2):735–69.CrossRef Björkman M, Svensson J. Power to the people: evidence from a randomized field experiment of a community-based monitoring project. Q J Econ. 2009;124(2):735–69.CrossRef
7.
go back to reference Boydell V, Keesbury J. “Social accountability: what are the lessons for improving family planning and reproductive health programs? A review of the literature” working paper. Washington, DC: Population Council, Evidence Project; 2014. Boydell V, Keesbury J. “Social accountability: what are the lessons for improving family planning and reproductive health programs? A review of the literature” working paper. Washington, DC: Population Council, Evidence Project; 2014.
8.
go back to reference Boydell V, Neema S, Wright K, Hardee K. Closing the Gap between People and Programs: Lessons from Implementation of Social Accountability for Family Planning and Reproductive Health in Uganda. Afr J Reprod Health. 2018;22(1):73–84.PubMed Boydell V, Neema S, Wright K, Hardee K. Closing the Gap between People and Programs: Lessons from Implementation of Social Accountability for Family Planning and Reproductive Health in Uganda. Afr J Reprod Health. 2018;22(1):73–84.PubMed
9.
go back to reference Dasgupta J. Ten years of negotiating rights around maternal health in Uttar Pradesh. India BMC Int Health Hum Rights. 2011;11:S4.CrossRefPubMed Dasgupta J. Ten years of negotiating rights around maternal health in Uttar Pradesh. India BMC Int Health Hum Rights. 2011;11:S4.CrossRefPubMed
11.
go back to reference Galavotti C, Wheeler T, Kuhlmann AS, Saggurti N, Narayanan P, Kiran U. Navigating the swampy lowland: a framework for evaluating the effect of community mobilisation in female sex workers in Avahan, the India AIDS initiative. J Epidemiol Community Health. 2012;66:9–15.CrossRef Galavotti C, Wheeler T, Kuhlmann AS, Saggurti N, Narayanan P, Kiran U. Navigating the swampy lowland: a framework for evaluating the effect of community mobilisation in female sex workers in Avahan, the India AIDS initiative. J Epidemiol Community Health. 2012;66:9–15.CrossRef
12.
go back to reference George AS. Using accountability to improve reproductive healthcare. Reproductive Health Matters. 2004;11(21):161–70.CrossRef George AS. Using accountability to improve reproductive healthcare. Reproductive Health Matters. 2004;11(21):161–70.CrossRef
13.
go back to reference Gullo S, Galavotti S, Sebert Kuhlmann A, Msiska T, Hastings P, Nathan MC. Effects of a social accountability approach, CARE’s Community Score Card, on reproductive health-related outcomes in Malawi: A cluster-randomized controlled evaluation. PlosOne. 2017. https://doi.org/10.1371/journal.pone.0171316. Gullo S, Galavotti S, Sebert Kuhlmann A, Msiska T, Hastings P, Nathan MC. Effects of a social accountability approach, CARE’s Community Score Card, on reproductive health-related outcomes in Malawi: A cluster-randomized controlled evaluation. PlosOne. 2017. https://​doi.​org/​10.​1371/​journal.​pone.​0171316.
14.
go back to reference Hamal M, de Cock BT, De Brouwere V, Bardají A, Dieleman M. How does social accountability contribute to better maternal health outcomes? A qualitative study on perceived changes with government and civil society actors in Gujarat, Indi. BMC Health Serv Res. 2018;18:653.CrossRefPubMedPubMedCentral Hamal M, de Cock BT, De Brouwere V, Bardají A, Dieleman M. How does social accountability contribute to better maternal health outcomes? A qualitative study on perceived changes with government and civil society actors in Gujarat, Indi. BMC Health Serv Res. 2018;18:653.CrossRefPubMedPubMedCentral
15.
go back to reference Harris S, Reichenbach L, Hardee K. Measuring and monitoring quality of care in family planning: are we ignoring negative experiences? Open Access J Contracept. 2016;7:97–108.PubMedPubMedCentral Harris S, Reichenbach L, Hardee K. Measuring and monitoring quality of care in family planning: are we ignoring negative experiences? Open Access J Contracept. 2016;7:97–108.PubMedPubMedCentral
17.
go back to reference Jain JK, Obare F, RamaRao S, Askew I. Reducing unmet need by supporting women with met need. Int Perspect Sex Reprod Health. 2013;39(3):133.CrossRefPubMed Jain JK, Obare F, RamaRao S, Askew I. Reducing unmet need by supporting women with met need. Int Perspect Sex Reprod Health. 2013;39(3):133.CrossRefPubMed
18.
go back to reference Joshi A. Legal empowerment and social accountability: complementary strategies toward rights-based development in health? World Dev. 2017;99:160–72.CrossRef Joshi A. Legal empowerment and social accountability: complementary strategies toward rights-based development in health? World Dev. 2017;99:160–72.CrossRef
19.
23.
go back to reference Kline P. Psychological testing. London: Routledge; 2000. Kline P. Psychological testing. London: Routledge; 2000.
25.
go back to reference Longfield K, Montagu D, editors. Quality measurement in family planning: past, present, future: papers from the Bellagio meeting on family planning quality, October 2015. Oakland: Metrics for Management; 2016. Longfield K, Montagu D, editors. Quality measurement in family planning: past, present, future: papers from the Bellagio meeting on family planning quality, October 2015. Oakland: Metrics for Management; 2016.
26.
go back to reference Marsh HW, Hau KT, Balla JR, Grayson D. Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivar Behav Res. 1998;33(2):181–220.CrossRef Marsh HW, Hau KT, Balla JR, Grayson D. Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivar Behav Res. 1998;33(2):181–220.CrossRef
27.
go back to reference Morof D, Steinauer J, Haider S, Liu S, Darney P, Barrett G. Evaluation of the London Measure of Unplanned Pregnancy in the a United States population of women. PloS One. 2012;7:4.CrossRef Morof D, Steinauer J, Haider S, Liu S, Darney P, Barrett G. Evaluation of the London Measure of Unplanned Pregnancy in the a United States population of women. PloS One. 2012;7:4.CrossRef
29.
go back to reference Papp SA, Gogoi A, Campbell C. Improving maternal health through social accountability: a case study from Orissa. India Glob Public Health. 2013;8:449–64.CrossRefPubMed Papp SA, Gogoi A, Campbell C. Improving maternal health through social accountability: a case study from Orissa. India Glob Public Health. 2013;8:449–64.CrossRefPubMed
31.
go back to reference Saggurti N, Mishra RM, Proddutoor L, Tucker S, Kovvali D, Parimi P, Wheeler T. Community collectivization and its association with consistent condom use and STI treatment-seeking behaviors among female sex workers and high-risk men who have sex with men/transgenders in Andhra Pradesh, India. AIDS Care. 2013;25:55–66. https://doi.org/10.1080/09540121.2012.749334 PMID: 23745631.CrossRef Saggurti N, Mishra RM, Proddutoor L, Tucker S, Kovvali D, Parimi P, Wheeler T. Community collectivization and its association with consistent condom use and STI treatment-seeking behaviors among female sex workers and high-risk men who have sex with men/transgenders in Andhra Pradesh, India. AIDS Care. 2013;25:55–66. https://​doi.​org/​10.​1080/​09540121.​2012.​749334 PMID: 23745631.CrossRef
33.
go back to reference Scott K, George AS, Harvey SA, Mondal S, Patel G, Gilson L, Sheikh K. Negotiating power relations, gender equality, and collective agency: are village health committees’ transformative social spaces in northern India? Int J Equity Health. 2017;16(1). https://doi.org/10.1186/s12939-017-0580-4. Scott K, George AS, Harvey SA, Mondal S, Patel G, Gilson L, Sheikh K. Negotiating power relations, gender equality, and collective agency: are village health committees’ transformative social spaces in northern India? Int J Equity Health. 2017;16(1). https://​doi.​org/​10.​1186/​s12939-017-0580-4.
34.
go back to reference Sebert Kuhlmann AK, Gullo S, Galavotti C, Grant C, Cavatore M, Posnock S. Women’s and health workers’ Voices in open, inclusive communities and effective spaces (VOICES): measuring governance outcomes in reproductive and maternal health Programmes. Dev Policy Rev. 2017;35(2):289–311.CrossRef Sebert Kuhlmann AK, Gullo S, Galavotti C, Grant C, Cavatore M, Posnock S. Women’s and health workers’ Voices in open, inclusive communities and effective spaces (VOICES): measuring governance outcomes in reproductive and maternal health Programmes. Dev Policy Rev. 2017;35(2):289–311.CrossRef
35.
go back to reference Singh S, et al. Adding it up: the costs and Benefi ts of investing in family planning and maternal and newborn health. New York: Guttmacher Institute and United Nations Population Fund; 2017. Singh S, et al. Adding it up: the costs and Benefi ts of investing in family planning and maternal and newborn health. New York: Guttmacher Institute and United Nations Population Fund; 2017.
37.
go back to reference Tumlinson K. Measuring quality of care: a review of previously used methodologies and indicators, Working Paper Two of the Measuring and Monitoring Quality of Services and Quality of Care Project. New York: Population Council; 2016. Tumlinson K. Measuring quality of care: a review of previously used methodologies and indicators, Working Paper Two of the Measuring and Monitoring Quality of Services and Quality of Care Project. New York: Population Council; 2016.
39.
go back to reference WHO. Closing the gap in a generation: Health equity through action on the social determinants of health. Geneva: WHO; 2008. WHO. Closing the gap in a generation: Health equity through action on the social determinants of health. Geneva: WHO; 2008.
40.
go back to reference WHO. Declaration of Astana: global confernce on primary health care. Geneva: WHO; 2018. WHO. Declaration of Astana: global confernce on primary health care. Geneva: WHO; 2018.
41.
go back to reference Williams G. Evaluating participatory development: tyranny, power and (re)politicization. Third World Q. 2004;25(3):557–78.CrossRef Williams G. Evaluating participatory development: tyranny, power and (re)politicization. Third World Q. 2004;25(3):557–78.CrossRef
42.
go back to reference Wright KQ, Boydell V, Hardee K. Validating a measure of rights-based family planning service delivery. Chicago: Presented at the 2017 annual Population Association of America Meeting in the session “Fertility, Family Planning and Sexual Health: Programs and Policies; 2017. Wright KQ, Boydell V, Hardee K. Validating a measure of rights-based family planning service delivery. Chicago: Presented at the 2017 annual Population Association of America Meeting in the session “Fertility, Family Planning and Sexual Health: Programs and Policies; 2017.
Metadata
Title
Adaptation and validation of social accountability measures in the context of contraceptive services in Ghana and Tanzania
Authors
Victoria Boydell
Petrus S. Steyn
Joanna Paula Cordero
Ndema Habib
My Huong Nguyen
Dela Nai
Donat Shamba
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Contraception
Published in
International Journal for Equity in Health / Issue 1/2020
Electronic ISSN: 1475-9276
DOI
https://doi.org/10.1186/s12939-020-01286-1

Other articles of this Issue 1/2020

International Journal for Equity in Health 1/2020 Go to the issue