Skip to main content
Top
Published in: BMC Pregnancy and Childbirth 1/2019

Open Access 01-12-2019 | Care | Research article

Measuring the quality of maternal and care processes at the time of delivery in sub-Saharan Africa: development and validation of a short index

Authors: Vandana Tripathi, Cynthia Stanton, Donna Strobino, Linda Bartlett

Published in: BMC Pregnancy and Childbirth | Issue 1/2019

Login to get access

Abstract

Background

There is a growing recognition that quality of care must improve in facility-based deliveries to achieve further global reductions in maternal and newborn mortality and morbidity. Better measurement of care quality is needed, but the unpredictable length of labor and delivery hinders the feasibility of observation, the gold standard in quality assessment. This study evaluated whether a measure restricted to actions at or immediately following delivery could provide a valid assessment of the quality of the process of intrapartum and immediate postpartum care (QoPIIPC), including essential newborn care.

Methods

The study used a comprehensive QoPIIPC index developed through a modified Delphi process and validated by delivery observation data as a starting point. A subset of items from this index assessed at or immediately following delivery was identified to create a “delivery-only” index. This delivery-only index was evaluated across content and criterion validation domains using delivery observation data from Kenya, Madagascar, and Tanzania, including Zanzibar.

Results

The delivery-only index included 13 items and performed well on most validation criteria, including correct classification of poorly and well-performed deliveries. Relative to the comprehensive QoPIIPC index, the delivery-only index had reduced content validity, representing fewer dimensions of QoPIIPC. The delivery-only index was also less strongly associated with overall quality performance in observed deliveries than the comprehensive QoPIIPC index.

Conclusions

Where supervision resources are limited, a measure of the quality of labor and delivery care targeting the time of delivery may mitigate challenges in observation-based assessment. The delivery-only index may enable increased use of observation-based quality assessment within maternal and newborn care programs in low-resource settings.
Literature
1.
go back to reference Lozano R, Wang H, Foreman KJ, Rajaratnam JK, Naghavi M, Marcus JR, et al. Progress towards millennium development goals 4 and 5 on maternal and child mortality: an updated systematic analysis. Lancet. 2011;378:1139–65.CrossRef Lozano R, Wang H, Foreman KJ, Rajaratnam JK, Naghavi M, Marcus JR, et al. Progress towards millennium development goals 4 and 5 on maternal and child mortality: an updated systematic analysis. Lancet. 2011;378:1139–65.CrossRef
2.
go back to reference Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, et al. Maternal mortality for 181 countries, 1980-2008: a systematic analysis of progress towards millennium development goal 5. Lancet. 2010;375:1609–23.CrossRef Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, et al. Maternal mortality for 181 countries, 1980-2008: a systematic analysis of progress towards millennium development goal 5. Lancet. 2010;375:1609–23.CrossRef
3.
go back to reference World Health Organization. Trends in maternal mortality: 1990 to 2015. Estimates developed by WHO, UNICEF, UNFPA and the World Bank. Geneva: World Health Organization; 2015. World Health Organization. Trends in maternal mortality: 1990 to 2015. Estimates developed by WHO, UNICEF, UNFPA and the World Bank. Geneva: World Health Organization; 2015.
4.
go back to reference Countdown to 2015. A Decade of Tracking Progress for Maternal, Newborn and Child: The 2015 Report. New York: UNICEF & World Health Organization; 2015. Countdown to 2015. A Decade of Tracking Progress for Maternal, Newborn and Child: The 2015 Report. New York: UNICEF & World Health Organization; 2015.
5.
go back to reference Lawn JE, Lee AC, Kinney M, Sibley L, Carlo WA, Paul VK, et al. Two million intrapartum-related stillbirths and neonatal deaths: where, why, and what can be done? Int J Gynaecol Obstet. 2009;107(Suppl 1):S5–18, S19.CrossRef Lawn JE, Lee AC, Kinney M, Sibley L, Carlo WA, Paul VK, et al. Two million intrapartum-related stillbirths and neonatal deaths: where, why, and what can be done? Int J Gynaecol Obstet. 2009;107(Suppl 1):S5–18, S19.CrossRef
6.
go back to reference Hodgins S. Achieving better maternal and newborn outcomes: coherent strategy and pragmatic, tailored implementation. Glob Health Sci Pract. 2013;1:146–53.CrossRef Hodgins S. Achieving better maternal and newborn outcomes: coherent strategy and pragmatic, tailored implementation. Glob Health Sci Pract. 2013;1:146–53.CrossRef
7.
go back to reference World Health Organization. Pregnancy, childbirth, postpartum and newborn Care: a guide for essential practice, integrated Management of Pregnancy and Childbirth Toolkit. Geneva: World Health Organization; 2006. World Health Organization. Pregnancy, childbirth, postpartum and newborn Care: a guide for essential practice, integrated Management of Pregnancy and Childbirth Toolkit. Geneva: World Health Organization; 2006.
8.
go back to reference Shankar A, Bartlett L, Fauveau V, Islam M, Terreri N. Countdown to 2015 maternal health group. Delivery of MDG 5 by active management with data. Lancet. 2008;371:1223–4.CrossRef Shankar A, Bartlett L, Fauveau V, Islam M, Terreri N. Countdown to 2015 maternal health group. Delivery of MDG 5 by active management with data. Lancet. 2008;371:1223–4.CrossRef
9.
go back to reference Campbell OM, Graham WJ. Lancet maternal survival series steering group: strategies for reducing maternal mortality: getting on with what works. Lancet. 2006;368:1284–99.CrossRef Campbell OM, Graham WJ. Lancet maternal survival series steering group: strategies for reducing maternal mortality: getting on with what works. Lancet. 2006;368:1284–99.CrossRef
10.
go back to reference Lawn JE, Kerber K, Enweronu-Laryea C, Massee Bateman O. Newborn survival in low resource settings--are we delivering? BJOG. 2009;116(Suppl 1):49–59.CrossRef Lawn JE, Kerber K, Enweronu-Laryea C, Massee Bateman O. Newborn survival in low resource settings--are we delivering? BJOG. 2009;116(Suppl 1):49–59.CrossRef
11.
go back to reference Ronsmans C, Campbell O. Quantifying the fall in mortality associated with interventions related to hypertensive diseases of pregnancy. BMC Public Health. 2011;11(Suppl 3):S8.CrossRef Ronsmans C, Campbell O. Quantifying the fall in mortality associated with interventions related to hypertensive diseases of pregnancy. BMC Public Health. 2011;11(Suppl 3):S8.CrossRef
12.
go back to reference Wall SN, Lee AC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol. 2010;34:395–407.CrossRef Wall SN, Lee AC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol. 2010;34:395–407.CrossRef
13.
go back to reference Firoz T, Sanghvi H, Merialdi M, von Dadelszen P. Pre-eclampsia in low and middle income countries. Best Pract Res Clin Obstet Gynaecol. 2011;25:537–48.CrossRef Firoz T, Sanghvi H, Merialdi M, von Dadelszen P. Pre-eclampsia in low and middle income countries. Best Pract Res Clin Obstet Gynaecol. 2011;25:537–48.CrossRef
14.
go back to reference Harvey SA, Blandón YC, McCaw-Binns A, Sandino I, Urbina L, Rodríguez C, et al. Nicaraguan maternal and neonatal health quality improvement group: are skilled birth attendants really skilled? A measurement method, some disturbing results and a potential way forward. Bull World Health Organ. 2007;85:783–90.CrossRef Harvey SA, Blandón YC, McCaw-Binns A, Sandino I, Urbina L, Rodríguez C, et al. Nicaraguan maternal and neonatal health quality improvement group: are skilled birth attendants really skilled? A measurement method, some disturbing results and a potential way forward. Bull World Health Organ. 2007;85:783–90.CrossRef
15.
go back to reference Stanton C, Armbruster D, Knight R, Ariawan I, Gbangbade S, Getachew A, et al. Use of active management of the third stage of labour in seven developing countries. Bull World Health Organ. 2009;87:207–15.CrossRef Stanton C, Armbruster D, Knight R, Ariawan I, Gbangbade S, Getachew A, et al. Use of active management of the third stage of labour in seven developing countries. Bull World Health Organ. 2009;87:207–15.CrossRef
16.
go back to reference Wall SN, Lee AC, Niermeyer S, English M, Keenan WJ, Carlo W, et al. Neonatal resuscitation in low-resource settings: what, who, and how to overcome challenges to scale up? Int J Gynaecol Obstet. 2009;107(Suppl 1):S47-62–S63-4. Wall SN, Lee AC, Niermeyer S, English M, Keenan WJ, Carlo W, et al. Neonatal resuscitation in low-resource settings: what, who, and how to overcome challenges to scale up? Int J Gynaecol Obstet. 2009;107(Suppl 1):S47-62–S63-4.
17.
go back to reference Randive B, Diwan V, De Costa A. India's conditional cash transfer Programme (the JSY) to promote institutional birth: is there an association between institutional birth proportion and maternal mortality? PLoS One. 2013;8:e67452.CrossRef Randive B, Diwan V, De Costa A. India's conditional cash transfer Programme (the JSY) to promote institutional birth: is there an association between institutional birth proportion and maternal mortality? PLoS One. 2013;8:e67452.CrossRef
18.
go back to reference Baral G. An assessment of the safe delivery incentive program at a tertiary level hospital in Nepal. J Nepal Health Res Counc. 2012;10:118–24.PubMed Baral G. An assessment of the safe delivery incentive program at a tertiary level hospital in Nepal. J Nepal Health Res Counc. 2012;10:118–24.PubMed
19.
go back to reference Powell-Jackson T, Neupane BD, Tiwari S, Tumbahangphe K, Manandhar D, Costello AM. The impact of Nepal's national incentive programme to promote safe delivery in the district of Makwanpur. Adv Health Econ Health Serv Res. 2009;21:221–49.PubMed Powell-Jackson T, Neupane BD, Tiwari S, Tumbahangphe K, Manandhar D, Costello AM. The impact of Nepal's national incentive programme to promote safe delivery in the district of Makwanpur. Adv Health Econ Health Serv Res. 2009;21:221–49.PubMed
20.
go back to reference World Health Organization. Managing complications in pregnancy and childbirth: a guide for midwives and doctors. Geneva: World Health Organization; 2003. World Health Organization. Managing complications in pregnancy and childbirth: a guide for midwives and doctors. Geneva: World Health Organization; 2003.
21.
go back to reference Maine D. What’s so special about maternal mortality? In: Barzelatto J, Berer M, Sundari RTK, editors. Safe motherhood initiatives: critical issues. Oxford: Blackwell Science/Reproductive Health Matters; 1999. Maine D. What’s so special about maternal mortality? In: Barzelatto J, Berer M, Sundari RTK, editors. Safe motherhood initiatives: critical issues. Oxford: Blackwell Science/Reproductive Health Matters; 1999.
22.
go back to reference Donabedian A. The definition of quality and approaches to its management, vol 1: Explorations in Quality Assessment and Monitoring. Ann Arbor: Health Administration Press; 1980. Donabedian A. The definition of quality and approaches to its management, vol 1: Explorations in Quality Assessment and Monitoring. Ann Arbor: Health Administration Press; 1980.
23.
go back to reference Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260:1743–8 Review.CrossRef Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260:1743–8 Review.CrossRef
25.
go back to reference Hulton L, Matthews Z, Stones RW. A framework for the evaluation of quality of care in maternity services. Southampton: University of Southampton; 2000. Hulton L, Matthews Z, Stones RW. A framework for the evaluation of quality of care in maternity services. Southampton: University of Southampton; 2000.
26.
go back to reference Bazant E, Rakotovao JP, Rasolofomanana JR, Tripathi V, Gomez P, Favero R, et al. Quality of care to prevent and treat postpartum hemorrhage and pre-eclampsia/eclampsia: an observational assessment in Madagascar's hospitals. Med Sante Trop. 2013;23:168–75.PubMed Bazant E, Rakotovao JP, Rasolofomanana JR, Tripathi V, Gomez P, Favero R, et al. Quality of care to prevent and treat postpartum hemorrhage and pre-eclampsia/eclampsia: an observational assessment in Madagascar's hospitals. Med Sante Trop. 2013;23:168–75.PubMed
27.
go back to reference Bailey P, Paxton A, Lobis S, Fry D. The availability of life-saving obstetric services in developing countries: an in-depth look at the signal functions for emergency obstetric care. Int J Gynaecol Obstet. 2006;93:285–91.CrossRef Bailey P, Paxton A, Lobis S, Fry D. The availability of life-saving obstetric services in developing countries: an in-depth look at the signal functions for emergency obstetric care. Int J Gynaecol Obstet. 2006;93:285–91.CrossRef
28.
go back to reference Paxton A, Bailey P, Lobis S. The United Nations process indicators for emergency obstetric care: reflections based on a decade of experience. Int J Gynaecol Obstet. 2006;95:192–208.CrossRef Paxton A, Bailey P, Lobis S. The United Nations process indicators for emergency obstetric care: reflections based on a decade of experience. Int J Gynaecol Obstet. 2006;95:192–208.CrossRef
29.
go back to reference Hermida J, Nicholas DD, Blumenfeld SN. Comparative validity of three methods for assessment of the quality of primary health care. Int J Qual Health Care. 1999;11:429–33.CrossRef Hermida J, Nicholas DD, Blumenfeld SN. Comparative validity of three methods for assessment of the quality of primary health care. Int J Qual Health Care. 1999;11:429–33.CrossRef
30.
go back to reference Leonard KL, Masatu MC. The use of direct clinician observation and vignettes for health services quality evaluation in developing countries. Soc Sci Med. 2005;61:1944–51.CrossRef Leonard KL, Masatu MC. The use of direct clinician observation and vignettes for health services quality evaluation in developing countries. Soc Sci Med. 2005;61:1944–51.CrossRef
31.
go back to reference Broughton EI, Ikram AN, Sahak I. How accurate are medical record data in Afghanistan's maternal health facilities? An observational validity study. BMJ Open. 2013;3:10.CrossRef Broughton EI, Ikram AN, Sahak I. How accurate are medical record data in Afghanistan's maternal health facilities? An observational validity study. BMJ Open. 2013;3:10.CrossRef
32.
go back to reference Duffy S, Crangle M. Delivery room logbook - fact or fiction? Trop Dr. 2009;39:145–9. Duffy S, Crangle M. Delivery room logbook - fact or fiction? Trop Dr. 2009;39:145–9.
33.
go back to reference Hofer TP, Bernstein SJ, DeMonner S, Hayward RA. Discussion between reviewers does not improve reliability of peer review of hospital quality. Med Care. 2000;38:152–61.CrossRef Hofer TP, Bernstein SJ, DeMonner S, Hayward RA. Discussion between reviewers does not improve reliability of peer review of hospital quality. Med Care. 2000;38:152–61.CrossRef
34.
go back to reference Localio AR, Weaver SL, Landis JR, Lawthers AG, Brenhan TA, Hebert L, et al. Identifying adverse events caused by medical care: degree of physician agreement in a retrospective chart review. Ann Intern Med. 1996;125:457–64.CrossRef Localio AR, Weaver SL, Landis JR, Lawthers AG, Brenhan TA, Hebert L, et al. Identifying adverse events caused by medical care: degree of physician agreement in a retrospective chart review. Ann Intern Med. 1996;125:457–64.CrossRef
35.
go back to reference Smith MA, Atherly AJ, Kane RL, Pacala JT. Peer review of the quality of care. Reliability and sources of variability for outcome and process assessments. JAMA. 1997;278:1573–8.CrossRef Smith MA, Atherly AJ, Kane RL, Pacala JT. Peer review of the quality of care. Reliability and sources of variability for outcome and process assessments. JAMA. 1997;278:1573–8.CrossRef
36.
go back to reference World Health Organization. Managing obstructed and prolonged labor: education materials for teachers of midwifery. Geneva: World Health Organization; 2006. World Health Organization. Managing obstructed and prolonged labor: education materials for teachers of midwifery. Geneva: World Health Organization; 2006.
37.
go back to reference Goga AE, Muhe LM. Global challenges with scale-up of the integrated management of childhood illness strategy: results of a multi-country survey. BMC Public Health. 2011;11:503.CrossRef Goga AE, Muhe LM. Global challenges with scale-up of the integrated management of childhood illness strategy: results of a multi-country survey. BMC Public Health. 2011;11:503.CrossRef
38.
go back to reference Manzi F, Schellenberg JA, Hutton G, Wyss K, Mbuya C, Shirima K, et al. Human resources for health care delivery in Tanzania: a multifaceted problem. Hum Resour Health. 2012;10:3.CrossRef Manzi F, Schellenberg JA, Hutton G, Wyss K, Mbuya C, Shirima K, et al. Human resources for health care delivery in Tanzania: a multifaceted problem. Hum Resour Health. 2012;10:3.CrossRef
39.
go back to reference Tripathi V, Stanton C, Strobino D, Bartlett L. Development and validation of an index to measure the quality of facility-based labor and delivery care processes in sub-Saharan Africa. PLoS One. 2015;10:e0129491.CrossRef Tripathi V, Stanton C, Strobino D, Bartlett L. Development and validation of an index to measure the quality of facility-based labor and delivery care processes in sub-Saharan Africa. PLoS One. 2015;10:e0129491.CrossRef
41.
go back to reference UNICEF. Levels and Trends in Child Mortality. Report 2010. Estimates developed by the UN inter-Agency Group for Child Mortality Estimation. New York: UNICEF. p. 2010. UNICEF. Levels and Trends in Child Mortality. Report 2010. Estimates developed by the UN inter-Agency Group for Child Mortality Estimation. New York: UNICEF. p. 2010.
42.
go back to reference World Health Organization. Atlas of Health Statistics of the African Region, 2011. Brazzaville: World Health Organization Regional Office for Africa; 2011. World Health Organization. Atlas of Health Statistics of the African Region, 2011. Brazzaville: World Health Organization Regional Office for Africa; 2011.
43.
go back to reference ACCESS Project. Best practices in maternal and newborn Care: a learning resource package for essential and basic emergency obstetric and newborn Care. Baltimore: Jhpiego; 2008. ACCESS Project. Best practices in maternal and newborn Care: a learning resource package for essential and basic emergency obstetric and newborn Care. Baltimore: Jhpiego; 2008.
46.
go back to reference Akobeng AK. Understanding diagnostic tests 3: receiver operating characteristic curves. Acta Paediatr. 2007;96:644–7.CrossRef Akobeng AK. Understanding diagnostic tests 3: receiver operating characteristic curves. Acta Paediatr. 2007;96:644–7.CrossRef
47.
go back to reference Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRef Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRef
48.
go back to reference Tunçalp Ӧ, Were WM, MacLennan C, Oladapo OT, Gülmezoglu AM, Bahl R, Daelmans B, Mathai M, Say L, Kristensen F, Temmerman M, Bustreo F. Quality of care for pregnant women and newborns-the WHO vision. BJOG. 2015 Jul;122(8):1045–9.CrossRef Tunçalp Ӧ, Were WM, MacLennan C, Oladapo OT, Gülmezoglu AM, Bahl R, Daelmans B, Mathai M, Say L, Kristensen F, Temmerman M, Bustreo F. Quality of care for pregnant women and newborns-the WHO vision. BJOG. 2015 Jul;122(8):1045–9.CrossRef
49.
go back to reference Souza JP, Gülmezoglu AM, Vogel J, Carroli G, Lumbiganon P, Qureshi Z, et al. Moving beyond essential interventions for reduction of maternal mortality (the WHO multicountry survey on maternal and newborn health): a cross-sectional study. Lancet. 2013;381:1747–55.CrossRef Souza JP, Gülmezoglu AM, Vogel J, Carroli G, Lumbiganon P, Qureshi Z, et al. Moving beyond essential interventions for reduction of maternal mortality (the WHO multicountry survey on maternal and newborn health): a cross-sectional study. Lancet. 2013;381:1747–55.CrossRef
50.
go back to reference Drife JO. Perinatal audit in low- and high-income countries. Semin Fetal Neonatal Med. 2006;11:29–36.CrossRef Drife JO. Perinatal audit in low- and high-income countries. Semin Fetal Neonatal Med. 2006;11:29–36.CrossRef
51.
go back to reference Kongnyuy EJ, Uthman OA. Use of criterion-based clinical audit to improve the quality of obstetric care: a systematic review. Acta Obstet Gynecol Scand. 2009;88:873–81.CrossRef Kongnyuy EJ, Uthman OA. Use of criterion-based clinical audit to improve the quality of obstetric care: a systematic review. Acta Obstet Gynecol Scand. 2009;88:873–81.CrossRef
52.
go back to reference Pirkle CM, Dumont A, Zunzunegui MV. Criterion-based clinical audit to assess quality of obstetrical care in low- and middle-income countries: a systematic review. Int J Qual Health Care. 2011;23:456–63.CrossRef Pirkle CM, Dumont A, Zunzunegui MV. Criterion-based clinical audit to assess quality of obstetrical care in low- and middle-income countries: a systematic review. Int J Qual Health Care. 2011;23:456–63.CrossRef
53.
go back to reference Lim SS, Dandona L, Hoisington JA, James SL, Hogan MC, Gakidou E. India's Janani Suraksha Yojana, a conditional cash transfer programme to increase births in health facilities: an impact evaluation. Lancet. 2010;375:2009–23.CrossRef Lim SS, Dandona L, Hoisington JA, James SL, Hogan MC, Gakidou E. India's Janani Suraksha Yojana, a conditional cash transfer programme to increase births in health facilities: an impact evaluation. Lancet. 2010;375:2009–23.CrossRef
54.
go back to reference Rusa L, Ngirabega Jde D, Janssen W, Van Bastelaere S, Porignon D, Vandenbulcke W. Performance-based financing for better quality of services in Rwandan health centres: 3-year experience. Tropical Med Int Health. 2009;14:830–7.CrossRef Rusa L, Ngirabega Jde D, Janssen W, Van Bastelaere S, Porignon D, Vandenbulcke W. Performance-based financing for better quality of services in Rwandan health centres: 3-year experience. Tropical Med Int Health. 2009;14:830–7.CrossRef
55.
go back to reference Eichler R, Auxila P, Pollock J. Flagship Program on Health Sector Reform and Sustainable Financing: Performance-based payment to improve the impact of health services: Evidence from Haiti. Washington, DC: World Bank; 2001. https://www.eldis.org/document/A29779. Accessed 10 Apr 2019. Eichler R, Auxila P, Pollock J. Flagship Program on Health Sector Reform and Sustainable Financing: Performance-based payment to improve the impact of health services: Evidence from Haiti. Washington, DC: World Bank; 2001. https://​www.​eldis.​org/​document/​A29779. Accessed 10 Apr 2019.
56.
go back to reference Fistula Care and Maternal Health Task Force. Revitalizing the partograph: does the evidence support a global call to action?—report of an expert meeting, New York, November 15–16, 2011. New York: EngenderHealth/Fistula Care; 2012. Fistula Care and Maternal Health Task Force. Revitalizing the partograph: does the evidence support a global call to action?—report of an expert meeting, New York, November 15–16, 2011. New York: EngenderHealth/Fistula Care; 2012.
Metadata
Title
Measuring the quality of maternal and care processes at the time of delivery in sub-Saharan Africa: development and validation of a short index
Authors
Vandana Tripathi
Cynthia Stanton
Donna Strobino
Linda Bartlett
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Pregnancy and Childbirth / Issue 1/2019
Electronic ISSN: 1471-2393
DOI
https://doi.org/10.1186/s12884-019-2281-z

Other articles of this Issue 1/2019

BMC Pregnancy and Childbirth 1/2019 Go to the issue