Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Care | Research article

Quality of maternal obstetric and neonatal care in low-income countries: development of a composite index

Authors: Danielle Wilhelm, Julia Lohmann, Manuela De Allegri, Jobiba Chinkhumba, Adamson S. Muula, Stephan Brenner

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

In low-income countries, studies demonstrate greater access and utilization of maternal and neonatal health services, yet mortality rates remain high with poor quality increasingly scrutinized as a potential point of failure in achieving expected goals. Comprehensive measures reflecting the multi-dimensional nature of quality of care could prove useful to quality improvement. However, existing tools often lack a systematic approach reflecting all aspects of quality considered relevant to maternal and newborn care. We aim to address this gap by illustrating the development of a composite index using a step-wise approach to evaluate the quality of maternal obstetric and neonatal healthcare in low-income countries.

Methods

The following steps were employed in creating a composite index: 1) developing a theoretical framework; 2) metric selection; 3) imputation of missing data; 4) initial data analysis 5) normalization 6) weighting and aggregating; 7) uncertainty and sensitivity analysis of resulting composite score; 8) and deconstruction of the index into its components. Based on this approach, we developed a base composite index and tested alternatives by altering the decisions taken at different stages of the construction process to account for missing values, normalization, and aggregation. The resulting single composite scores representing overall maternal obstetric and neonatal healthcare quality were used to create facility rankings and further disaggregated into sub-composites of quality of care.

Results

The resulting composite scores varied considerably in absolute values and ranges based on method choice. However, the respective coefficients produced by the Spearman rank correlations comparing facility rankings by method choice showed a high degree of correlation. Differences in method of aggregation had the greatest amount of variation in facility rankings compared to the base case. Z-score standardization most closely aligned with the base case, but limited comparability at disaggregated levels.

Conclusions

This paper illustrates development of a composite index reflecting the multi-dimensional nature of maternal obstetric and neonatal healthcare. We employ a step-wise process applicable to a wide range of obstetric quality of care assessment programs in low-income countries which is adaptable to setting and context. In exploring alternative approaches, certain decisions influencing the interpretation of a given index are highlighted.
Appendix
Available only for authorised users
Literature
1.
go back to reference WHO Trends in. Maternal mortality: 1990 to 2013 - estimates by WHO, UNICEF, UNFPA, the World Bank and the United Nations population division. Geneva: World Health Organization; 2014. WHO Trends in. Maternal mortality: 1990 to 2013 - estimates by WHO, UNICEF, UNFPA, the World Bank and the United Nations population division. Geneva: World Health Organization; 2014.
2.
go back to reference Lawn JE, Lee ACC, Kinney M, Sibley L, Carlo WA, Paul VK, et al. Two million intrapartum-related stillbirths and neonatal deaths: where, why, and what can be done? Int J Gynaecol Obstet. 2009;107(Suppl 1):S5–18 S19.CrossRef Lawn JE, Lee ACC, Kinney M, Sibley L, Carlo WA, Paul VK, et al. Two million intrapartum-related stillbirths and neonatal deaths: where, why, and what can be done? Int J Gynaecol Obstet. 2009;107(Suppl 1):S5–18 S19.CrossRef
3.
go back to reference Wall SN, Lee ACC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol. 2010;34(6):395–407.CrossRef Wall SN, Lee ACC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol. 2010;34(6):395–407.CrossRef
4.
go back to reference Tripathi V, Stanton C, Strobino D, Bartlett L. Development and validation of an index to measure the quality of facility-based labor and delivery care processes in sub-Saharan Africa. PLoS One. 2015;10(6):e0129491.CrossRef Tripathi V, Stanton C, Strobino D, Bartlett L. Development and validation of an index to measure the quality of facility-based labor and delivery care processes in sub-Saharan Africa. PLoS One. 2015;10(6):e0129491.CrossRef
5.
go back to reference Ronsmans C, Graham WJ. Maternal mortality. Who, when, where, and why. Lancet. 2006;368(9542):1189–200.CrossRef Ronsmans C, Graham WJ. Maternal mortality. Who, when, where, and why. Lancet. 2006;368(9542):1189–200.CrossRef
6.
go back to reference Akachi Y, Kruk ME. Quality of care: measuring a neglected driver of improved health. Bull World Health Organ. 2017;95(6):465–72.CrossRef Akachi Y, Kruk ME. Quality of care: measuring a neglected driver of improved health. Bull World Health Organ. 2017;95(6):465–72.CrossRef
7.
go back to reference Miller S, Cordero M, Coleman AL, Figueroa J, Brito-Anderson S, Dabagh R, et al. Quality of care in institutionalized deliveries: the paradox of the Dominican Republic. Int J Gynaecol Obstet. 2003;82(1):89–103-88.CrossRef Miller S, Cordero M, Coleman AL, Figueroa J, Brito-Anderson S, Dabagh R, et al. Quality of care in institutionalized deliveries: the paradox of the Dominican Republic. Int J Gynaecol Obstet. 2003;82(1):89–103-88.CrossRef
8.
go back to reference Randive B, Diwan V, De Costa A. India’s conditional cash transfer Programme (the JSY) to promote institutional birth: is there an association between institutional birth proportion and maternal mortality? PLoS One. 2013;8(6):e67452.CrossRef Randive B, Diwan V, De Costa A. India’s conditional cash transfer Programme (the JSY) to promote institutional birth: is there an association between institutional birth proportion and maternal mortality? PLoS One. 2013;8(6):e67452.CrossRef
9.
go back to reference Lawn JE, Kinney M, Lee AC, Chopra M, Donnay F, Paul VK, et al. Reducing intrapartum-related deaths and disability: can the health system deliver? Int J Gynecol Obstet. 2009;107(Supplement):S123–42.CrossRef Lawn JE, Kinney M, Lee AC, Chopra M, Donnay F, Paul VK, et al. Reducing intrapartum-related deaths and disability: can the health system deliver? Int J Gynecol Obstet. 2009;107(Supplement):S123–42.CrossRef
10.
go back to reference Morestin F, Bicaba A, Sermé J de D, Fournier P. Evaluating quality of obstetric care in low-resource settings: building on the literature to design tailor-made evaluation instruments--an illustration in Burkina Faso. BMC Health Serv Res. 2010;10:20.CrossRef Morestin F, Bicaba A, Sermé J de D, Fournier P. Evaluating quality of obstetric care in low-resource settings: building on the literature to design tailor-made evaluation instruments--an illustration in Burkina Faso. BMC Health Serv Res. 2010;10:20.CrossRef
11.
go back to reference National Quality Forum (NQF). Composite measure evaluation framework and National Voluntary Consensus Standards for mortality and safety— composite measures: a consensus report. Washington, DC: NQF; 2009. National Quality Forum (NQF). Composite measure evaluation framework and National Voluntary Consensus Standards for mortality and safety— composite measures: a consensus report. Washington, DC: NQF; 2009.
12.
go back to reference European Commission. Organisation for economic co-operation and development, SourceOECD (online service), editors. Handbook on constructing composite indicators: methodology and user guide. Paris: OECD; 2008. p. 158. European Commission. Organisation for economic co-operation and development, SourceOECD (online service), editors. Handbook on constructing composite indicators: methodology and user guide. Paris: OECD; 2008. p. 158.
13.
go back to reference Profit J, Kowalkowski MA, Zupancic JAF, Pietz K, Richardson P, Draper D, et al. Baby-MONITOR: a composite indicator of NICU quality. Pediatrics. 2014;134(1):74–82.CrossRef Profit J, Kowalkowski MA, Zupancic JAF, Pietz K, Richardson P, Draper D, et al. Baby-MONITOR: a composite indicator of NICU quality. Pediatrics. 2014;134(1):74–82.CrossRef
14.
go back to reference Profit J, Typpo KV, Hysong SJ, Woodard LD, Kallen MA, Petersen LA. Improving benchmarking by using an explicit framework for the development of composite indicators: an example using pediatric quality of care. Implement Sci. 2010;5(1):13.CrossRef Profit J, Typpo KV, Hysong SJ, Woodard LD, Kallen MA, Petersen LA. Improving benchmarking by using an explicit framework for the development of composite indicators: an example using pediatric quality of care. Implement Sci. 2010;5(1):13.CrossRef
15.
go back to reference Reeves D, Campbell SM, Adams J, Shekelle PG, Kontopantelis E, Roland MO. Combining multiple indicators of clinical quality: an evaluation of different analytic approaches. Med Care. 2007;45(6):489–96.CrossRef Reeves D, Campbell SM, Adams J, Shekelle PG, Kontopantelis E, Roland MO. Combining multiple indicators of clinical quality: an evaluation of different analytic approaches. Med Care. 2007;45(6):489–96.CrossRef
17.
go back to reference Paxton A, Bailey P, Lobis S. The United Nations process indicators for emergency obstetric care. Reflections based on a decade of experience. Int J Gynecol Obstet. 2006;95(2):192–208.CrossRef Paxton A, Bailey P, Lobis S. The United Nations process indicators for emergency obstetric care. Reflections based on a decade of experience. Int J Gynecol Obstet. 2006;95(2):192–208.CrossRef
20.
go back to reference Bonfrer I, Van de Poel E, Van Doorslaer E. The effects of performance incentives on the utilization and quality of maternal and child care in Burundi. Soc Sci Med. 2014;123:96–104.CrossRef Bonfrer I, Van de Poel E, Van Doorslaer E. The effects of performance incentives on the utilization and quality of maternal and child care in Burundi. Soc Sci Med. 2014;123:96–104.CrossRef
22.
go back to reference Basinga P, Gertler PJ, Binagwaho A, Soucat ALB, Sturdy J, Vermeersch CMJ. Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation. Lancet. 2011;377(9775):1421–8.CrossRef Basinga P, Gertler PJ, Binagwaho A, Soucat ALB, Sturdy J, Vermeersch CMJ. Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation. Lancet. 2011;377(9775):1421–8.CrossRef
23.
go back to reference Fritsche GB, Soeters R, Meessen B. Performance-based financing toolkit. Washington, D.C.: World Bank; 2014.CrossRef Fritsche GB, Soeters R, Meessen B. Performance-based financing toolkit. Washington, D.C.: World Bank; 2014.CrossRef
25.
go back to reference Tripathi V. A literature review of quantitative indicators to measure the quality of labor and delivery care. Int J Gynaecol Obstet. 2016;132(2):139–45.CrossRef Tripathi V. A literature review of quantitative indicators to measure the quality of labor and delivery care. Int J Gynaecol Obstet. 2016;132(2):139–45.CrossRef
26.
go back to reference Chalmers B, Porter R. Assessing effective care in normal labor: the Bologna score. Birth Berkeley Calif. 2001;28(2):79–83.CrossRef Chalmers B, Porter R. Assessing effective care in normal labor: the Bologna score. Birth Berkeley Calif. 2001;28(2):79–83.CrossRef
27.
go back to reference Arscott-Mills S, Hobson R, Ricca J, Morgan L. MCHIP technical summary: quality of care. Baltimore: Jhpiego; 2014. Arscott-Mills S, Hobson R, Ricca J, Morgan L. MCHIP technical summary: quality of care. Baltimore: Jhpiego; 2014.
28.
go back to reference Brenner S, Muula AS, Robyn P, Bärnighausen T, Sarker M, Mathanga DP, et al. Design of an impact evaluation using a mixed methods model – an explanatory assessment of the effects of results-based financing mechanisms on maternal healthcare services in Malawi. BMC Health Serv Res. 2014;14(1):180.CrossRef Brenner S, Muula AS, Robyn P, Bärnighausen T, Sarker M, Mathanga DP, et al. Design of an impact evaluation using a mixed methods model – an explanatory assessment of the effects of results-based financing mechanisms on maternal healthcare services in Malawi. BMC Health Serv Res. 2014;14(1):180.CrossRef
29.
go back to reference Maxwell RJ. Dimensions of quality revisited: from thought to action. Qual Health Care QHC. 1992;1(3):171–7.CrossRef Maxwell RJ. Dimensions of quality revisited: from thought to action. Qual Health Care QHC. 1992;1(3):171–7.CrossRef
30.
go back to reference WHO, editor. Quality of care: a process for making strategic choices in health systems. Geneva: WHO; 2006. p. 38. WHO, editor. Quality of care: a process for making strategic choices in health systems. Geneva: WHO; 2006. p. 38.
31.
go back to reference Profit J, Zupancic JAF, Gould JB, Petersen LA. Implementing pay-for-performance in the neonatal intensive care unit. Pediatrics. 2007;119(5):975–82.CrossRef Profit J, Zupancic JAF, Gould JB, Petersen LA. Implementing pay-for-performance in the neonatal intensive care unit. Pediatrics. 2007;119(5):975–82.CrossRef
32.
go back to reference Institute of Medicine (U.S.). Crossing the quality chasm: a new health system for the 21st century. Washington, D.C: National Academy Press; 2001. p. 337. Institute of Medicine (U.S.). Crossing the quality chasm: a new health system for the 21st century. Washington, D.C: National Academy Press; 2001. p. 337.
33.
go back to reference Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q. 2005;83(4):691–729.CrossRef Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q. 2005;83(4):691–729.CrossRef
34.
go back to reference World Health Organization. Standards for improving quality of maternal and newborn care in health facilities. Geneva: World Health Organization; 2016. World Health Organization. Standards for improving quality of maternal and newborn care in health facilities. Geneva: World Health Organization; 2016.
35.
go back to reference World Health Organization. WHO Safe Childbirth Checklist. 2015. World Health Organization. WHO Safe Childbirth Checklist. 2015.
36.
go back to reference WHO. Service Availability and Readiness Assessment (SARA): An annual monitoring system for service delivery. Geneva: World Health Organization (WHO); 2015. WHO. Service Availability and Readiness Assessment (SARA): An annual monitoring system for service delivery. Geneva: World Health Organization (WHO); 2015.
37.
go back to reference Campbell OM, Graham WJ. Strategies for reducing maternal mortality. Getting on with what works. Lancet. 2006;368(9543):1284–99.CrossRef Campbell OM, Graham WJ. Strategies for reducing maternal mortality. Getting on with what works. Lancet. 2006;368(9543):1284–99.CrossRef
38.
go back to reference Faye A, Dumont A, Ndiaye P, Fournier P. Development of an instrument to evaluate intrapartum care quality in Senegal: evaluation quality care. Int J Qual Health Care. 2014;26(2):184–9.CrossRef Faye A, Dumont A, Ndiaye P, Fournier P. Development of an instrument to evaluate intrapartum care quality in Senegal: evaluation quality care. Int J Qual Health Care. 2014;26(2):184–9.CrossRef
39.
go back to reference Gabrysch S, Civitelli G, Edmond KM, Mathai M, Ali M, Bhutta ZA, et al. New signal functions to measure the ability of health facilities to provide routine and emergency newborn care. PLoS Med. 2012;9(11):e1001340.CrossRef Gabrysch S, Civitelli G, Edmond KM, Mathai M, Ali M, Bhutta ZA, et al. New signal functions to measure the ability of health facilities to provide routine and emergency newborn care. PLoS Med. 2012;9(11):e1001340.CrossRef
40.
go back to reference World Health Organization and the Partnership for Maternal, Newborn and Child Health (2014). Consultation on improving measurement of the quality of maternal, newborn and child care in health facilities. Ferney Voltaire Geneva: WHO & PMNCH; 2013. World Health Organization and the Partnership for Maternal, Newborn and Child Health (2014). Consultation on improving measurement of the quality of maternal, newborn and child care in health facilities. Ferney Voltaire Geneva: WHO & PMNCH; 2013.
41.
go back to reference Narayan I, Rose M, Faillace S, Sanghvi T. The Components of Essential Newborn Care. Arlington, Virginia: Published by the Basics Support for Institutionalizing Child Survival Project (BASICS II) for the United States Agency for International Development; 2004. Narayan I, Rose M, Faillace S, Sanghvi T. The Components of Essential Newborn Care. Arlington, Virginia: Published by the Basics Support for Institutionalizing Child Survival Project (BASICS II) for the United States Agency for International Development; 2004.
44.
go back to reference Brenner S, De Allegri M, Gabrysch S, Chinkhumba J, Sarker M, Muula AS. The quality of clinical maternal and neonatal healthcare - a strategy for identifying “routine care signal functions”. PLoS One. 2015;10(4):e0123968.CrossRef Brenner S, De Allegri M, Gabrysch S, Chinkhumba J, Sarker M, Muula AS. The quality of clinical maternal and neonatal healthcare - a strategy for identifying “routine care signal functions”. PLoS One. 2015;10(4):e0123968.CrossRef
45.
go back to reference Kruk ME, Freedman LP. Assessing health system performance in developing countries: a review of the literature. Health Policy. 2008;85(3):263–76.CrossRef Kruk ME, Freedman LP. Assessing health system performance in developing countries: a review of the literature. Health Policy. 2008;85(3):263–76.CrossRef
46.
go back to reference Gelman A, Hill J. Data analysis using regression and multilevel/hierarchical models. Cambridge; New York: Cambridge University Press; 2007. p. 625. (Analytical methods for social research) Gelman A, Hill J. Data analysis using regression and multilevel/hierarchical models. Cambridge; New York: Cambridge University Press; 2007. p. 625. (Analytical methods for social research)
47.
go back to reference Huang R, Liang Y, Carriere KC. The role of proxy information in missing data analysis. Stat Methods Med Res. 2005;14(5):457–71.CrossRef Huang R, Liang Y, Carriere KC. The role of proxy information in missing data analysis. Stat Methods Med Res. 2005;14(5):457–71.CrossRef
48.
go back to reference Adegoke A, Utz B, Msuya SE, van den Broek N. Skilled birth attendants: who is who? A descriptive study of definitions and roles from nine sub Saharan African countries. PLoS One. 2012;7(7):e40220.CrossRef Adegoke A, Utz B, Msuya SE, van den Broek N. Skilled birth attendants: who is who? A descriptive study of definitions and roles from nine sub Saharan African countries. PLoS One. 2012;7(7):e40220.CrossRef
49.
go back to reference Couralet M, Guérin S, Le Vaillant M, Loirat P, Minvielle E. Constructing a composite quality score for the care of acute myocardial infarction patients at discharge: impact on hospital ranking. Med Care. 2011;49(6):569–76.CrossRef Couralet M, Guérin S, Le Vaillant M, Loirat P, Minvielle E. Constructing a composite quality score for the care of acute myocardial infarction patients at discharge: impact on hospital ranking. Med Care. 2011;49(6):569–76.CrossRef
50.
go back to reference Bobko P, Roth PL, Buster MA. The usefulness of unit weights in creating composite scores: a literature review, application to content validity, and meta-analysis. Organ Res Methods. 2007;10(4):689–709.CrossRef Bobko P, Roth PL, Buster MA. The usefulness of unit weights in creating composite scores: a literature review, application to content validity, and meta-analysis. Organ Res Methods. 2007;10(4):689–709.CrossRef
51.
go back to reference Saisana M, Saltelli A, Tarantola S. Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. J R Stat Soc Ser A Stat Soc. 2005;168(2):307–23.CrossRef Saisana M, Saltelli A, Tarantola S. Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. J R Stat Soc Ser A Stat Soc. 2005;168(2):307–23.CrossRef
52.
go back to reference Ministry of Health Malawi, ICF International. Malawi Service Provision Assessment (MSPA) 2013-14. Lilongwe, Malawi, and Rockville, Maryland: MoH and ICF International; 2014. Ministry of Health Malawi, ICF International. Malawi Service Provision Assessment (MSPA) 2013-14. Lilongwe, Malawi, and Rockville, Maryland: MoH and ICF International; 2014.
53.
go back to reference National Statistical Office (Malawi). Malawi Demographic and Health Survey 2010. Zomba: National Statistical Office (Malawi); 2011. National Statistical Office (Malawi). Malawi Demographic and Health Survey 2010. Zomba: National Statistical Office (Malawi); 2011.
55.
go back to reference Borghi J, Ensor T, Somanathan A, Lissner C, Mills A. Mobilising financial resources for maternal health. Lancet. 2006;368(9545):1457–65.CrossRef Borghi J, Ensor T, Somanathan A, Lissner C, Mills A. Mobilising financial resources for maternal health. Lancet. 2006;368(9545):1457–65.CrossRef
56.
go back to reference Cromwell J. Research Triangle Institute., editors. Pay for performance in health care: methods and approaches. Research Triangle Park: RTI Press; 2011. p. 386. (RTI Press Book series)CrossRef Cromwell J. Research Triangle Institute., editors. Pay for performance in health care: methods and approaches. Research Triangle Park: RTI Press; 2011. p. 386. (RTI Press Book series)CrossRef
57.
go back to reference Das A, Gopalan SS, Chandramohan D. Effect of pay for performance to improve quality of maternal and child care in low- and middle-income countries: a systematic review. BMC Public Health. 2016;16:321.CrossRef Das A, Gopalan SS, Chandramohan D. Effect of pay for performance to improve quality of maternal and child care in low- and middle-income countries: a systematic review. BMC Public Health. 2016;16:321.CrossRef
58.
go back to reference Savedoff WD. Basic economics of results-based financing in health. Bath, Maine: Social Insight; 2010. (Social Insight) Savedoff WD. Basic economics of results-based financing in health. Bath, Maine: Social Insight; 2010. (Social Insight)
59.
go back to reference Wyber R, Vaillancourt S, Perry W, Mannava P, Folaranmi T, Celi LA. Big data in global health: improving health in low- and middle-income countries. Bull World Health Organ. 2015;93(3):203–8.CrossRef Wyber R, Vaillancourt S, Perry W, Mannava P, Folaranmi T, Celi LA. Big data in global health: improving health in low- and middle-income countries. Bull World Health Organ. 2015;93(3):203–8.CrossRef
60.
go back to reference Jacobs R, Goddard M, Smith PC. How robust are hospital ranks based on composite performance measures? Med Care. 2005;43(12):1177–84.CrossRef Jacobs R, Goddard M, Smith PC. How robust are hospital ranks based on composite performance measures? Med Care. 2005;43(12):1177–84.CrossRef
61.
go back to reference Hayward RA. All-or-nothing treatment targets make bad performance measures. Am J Manag Care. 2007;13(3):126–8.PubMed Hayward RA. All-or-nothing treatment targets make bad performance measures. Am J Manag Care. 2007;13(3):126–8.PubMed
62.
go back to reference Nolan T, Berwick DM. All-or-none measurement raises the Bar on performance. JAMA. 2006;295(10):1168.CrossRef Nolan T, Berwick DM. All-or-none measurement raises the Bar on performance. JAMA. 2006;295(10):1168.CrossRef
Metadata
Title
Quality of maternal obstetric and neonatal care in low-income countries: development of a composite index
Authors
Danielle Wilhelm
Julia Lohmann
Manuela De Allegri
Jobiba Chinkhumba
Adamson S. Muula
Stephan Brenner
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0790-0

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue