Skip to main content
Top
Published in: BMC Pregnancy and Childbirth 1/2018

Open Access 01-12-2018 | Research article

Construction and pilot test of a set of indicators to assess the implementation and effectiveness of the who safe childbirth checklist

Authors: Pedro J. Saturno-Hernández, María Fernández-Elorriaga, Ismael Martínez-Nicolás, Ofelia Poblano-Verástegui

Published in: BMC Pregnancy and Childbirth | Issue 1/2018

Login to get access

Abstract

Background

The World Health Organization (WHO) launched the “Safe Childbirth Checklist (SCC) Collaboration” in 2012. The SCC is designed to contribute to quality care by providing reminders of evidence-based practices for the prevention and management of the leading causes of maternal and neonatal morbidity and mortality. However, indicators to monitor the implementation and effectiveness of the SCC have not been defined. This study aimed to produce and pilot test a set of valid, reliable and feasible indicators to assess the implementation and effectiveness of the SCC, with an emphasis on best practices.

Methods

As part of the WHO Collaboration, the SCC was adapted to the Mexican context, and a set of indicators was developed to assess the SCC use and adherence to SCC-related best practices. The indicators were pilot tested in three hospitals for feasibility and reliability using the prevalence- and bias-adjusted kappa index (PABAK) for multiple independent evaluators (initial sample, n = 47; second sample, n = 30 to re-test reliability). The data sources were clinical records and cognitive tests drawn from questionnaires to mothers and health professionals.

Results

We generated 53 indicators, and 38 of the indicators (those related to best practices and outcomes) were pilot tested. Of these, 26 relate to care for the mother (20 were measured based on clinical records and 6 via questionnaire), and 12 relate to newborn care (9 were medical record-based and 3 were from questionnaires). Feasible indicators were generally also reliable (PABAK≥0.6). Routine feasibility is affected by the frequency of assessed events.

Conclusions

The generated indicators allow an assessment of the implementation and effectiveness of the SCC and the monitoring of quality of care during childbirth and the immediate postpartum period.
Appendix
Available only for authorised users
Literature
2.
3.
4.
go back to reference Austin LA, Salam RA, Lassi ZS, Das JK, Bhutta ZA. Approaches to improve quality of maternal and newborn health care: an overview of the evidence. Reprod Health. 2014;11(Suppl 2):1–9.CrossRef Austin LA, Salam RA, Lassi ZS, Das JK, Bhutta ZA. Approaches to improve quality of maternal and newborn health care: an overview of the evidence. Reprod Health. 2014;11(Suppl 2):1–9.CrossRef
5.
go back to reference Gutiérrez J, Rivera-Dommarco J, Shamah-Levy T, et al. Encuesta Nacional de Salud Y Nutrición 2012. Resultados Nacionales. Cuernavaca: Instituto Nacional de Salud Pública; 2012. Gutiérrez J, Rivera-Dommarco J, Shamah-Levy T, et al. Encuesta Nacional de Salud Y Nutrición 2012. Resultados Nacionales. Cuernavaca: Instituto Nacional de Salud Pública; 2012.
6.
go back to reference Lazcano-Ponce E, Schiavon R, Uribe-Zúñiga P, et al. Cobertura de atención del parto en México . Su interpretación en el contexto de la mortalidad materna. Salud Publica Mex. 2013;55(suppl 2):S214–24.CrossRefPubMed Lazcano-Ponce E, Schiavon R, Uribe-Zúñiga P, et al. Cobertura de atención del parto en México . Su interpretación en el contexto de la mortalidad materna. Salud Publica Mex. 2013;55(suppl 2):S214–24.CrossRefPubMed
7.
go back to reference Trends in maternal mortality: 1990 to 2015: estimates by WHO, UNICEF, UNFPA, World Bank Group and the United Nations Population Division. Geneva: World Health Organization; 2015. Trends in maternal mortality: 1990 to 2015: estimates by WHO, UNICEF, UNFPA, World Bank Group and the United Nations Population Division. Geneva: World Health Organization; 2015.
9.
go back to reference Gobierno de la República. Plan Nacional de Desarrollo 2013–2018 plan: Programa del Sector Salud. Mexico: Diario Oficial de la Federación; 2013. Gobierno de la República. Plan Nacional de Desarrollo 2013–2018 plan: Programa del Sector Salud. Mexico: Diario Oficial de la Federación; 2013.
10.
go back to reference Van den Broek NR, Graham WJ. Quality of care for maternal and newborn health: the neglected agenda. BJOG. 2009;116(Suppl 1):18–21.CrossRefPubMed Van den Broek NR, Graham WJ. Quality of care for maternal and newborn health: the neglected agenda. BJOG. 2009;116(Suppl 1):18–21.CrossRefPubMed
11.
go back to reference Spector JM, Agrawal P, Kodkany B, Lipsitz S, Lashoher A, Dziekan G. Et to the. Improving quality of care for maternal and newborn health: prospective pilot study of the WHO safe childbirth checklist program. PLoS One. 2012;7(5):e35151.CrossRefPubMedPubMedCentral Spector JM, Agrawal P, Kodkany B, Lipsitz S, Lashoher A, Dziekan G. Et to the. Improving quality of care for maternal and newborn health: prospective pilot study of the WHO safe childbirth checklist program. PLoS One. 2012;7(5):e35151.CrossRefPubMedPubMedCentral
13.
go back to reference Semrau KEA, Hirschhorn LR, Kodkany B, et al. Effectiveness of the WHO safe childbirth checklist program in reducing severe maternal, fetal, and newborn harm in Uttar Pradesh, India: study protocol for a matched-pair, cluster-randomized controlled trial. Trials. 2016;17(1):576.CrossRefPubMedPubMedCentral Semrau KEA, Hirschhorn LR, Kodkany B, et al. Effectiveness of the WHO safe childbirth checklist program in reducing severe maternal, fetal, and newborn harm in Uttar Pradesh, India: study protocol for a matched-pair, cluster-randomized controlled trial. Trials. 2016;17(1):576.CrossRefPubMedPubMedCentral
14.
go back to reference Kara N, Firestone R, Kalita T, et al. The better birth program: pursuing effective adoption and sustained use of the WHO safe childbirth checklist through coaching-based implementation in Uttar Pradesh, India. Global Health Sci Pract. 2017;5(2):232–43.CrossRef Kara N, Firestone R, Kalita T, et al. The better birth program: pursuing effective adoption and sustained use of the WHO safe childbirth checklist through coaching-based implementation in Uttar Pradesh, India. Global Health Sci Pract. 2017;5(2):232–43.CrossRef
16.
go back to reference Delaney MM, Maji P, Kalita T, Kara N, Rana D, Kumar K, et al. Improving adherence to essential birth practices using the WHO safe childbirth checklist with peer coaching: experience from 60 public health facilities in Uttar Pradesh, India. Global Health Sci Pract. 2017;5(2):217–31.CrossRef Delaney MM, Maji P, Kalita T, Kara N, Rana D, Kumar K, et al. Improving adherence to essential birth practices using the WHO safe childbirth checklist with peer coaching: experience from 60 public health facilities in Uttar Pradesh, India. Global Health Sci Pract. 2017;5(2):217–31.CrossRef
17.
go back to reference Patabendige M, Senanayake H. Implementation of the WHO safe childbirth checklist program at a tertiary care setting in Sri Lanka: a developing country experience. BMC Pregnancy Childbirth. 2015;15(1):12.CrossRefPubMedPubMedCentral Patabendige M, Senanayake H. Implementation of the WHO safe childbirth checklist program at a tertiary care setting in Sri Lanka: a developing country experience. BMC Pregnancy Childbirth. 2015;15(1):12.CrossRefPubMedPubMedCentral
18.
go back to reference Kabongo L, Gass J, Kivondo B, Kara N, Semrau K, Hirschhorn LR. Implementing the WHO safe childbirth checklist: lessons learnt on a quality improvement initiative to improve mother and newborn care at Gobabis District hospital, Namibia. BMJ Open Qual. 2017; https://doi.org/10.1136/%20bmjoq-2017-000145. Kabongo L, Gass J, Kivondo B, Kara N, Semrau K, Hirschhorn LR. Implementing the WHO safe childbirth checklist: lessons learnt on a quality improvement initiative to improve mother and newborn care at Gobabis District hospital, Namibia. BMJ Open Qual. 2017; https://​doi.​org/​10.​1136/​%20​bmjoq-2017-000145.
19.
go back to reference Gertler P, Martínez S, Premand P, Rawlings L, Vermeerschm CM. Impact evaluation in practice. World Bank: Washington, D.C.; 2011. p. 235. Gertler P, Martínez S, Premand P, Rawlings L, Vermeerschm CM. Impact evaluation in practice. World Bank: Washington, D.C.; 2011. p. 235.
21.
go back to reference United Nations. Indicators of sustainable development: guidelines and methodologies. 3d ed. New York: United Nations; 2007. United Nations. Indicators of sustainable development: guidelines and methodologies. 3d ed. New York: United Nations; 2007.
23.
go back to reference World Health Organization. Standards for improving quality of maternal and newborn care in health facilities. Geneva: World Health Organization; 2016. p. 73. World Health Organization. Standards for improving quality of maternal and newborn care in health facilities. Geneva: World Health Organization; 2016. p. 73.
24.
go back to reference Saturno P, Martinez-Nicholas I, Robles-García I, López-Soriano F, Angel-garcia D. Development and pilot test of a new set of good practice indicators for chronic cancer pain management. Eur J Pain. 2015;19(1):28–38.CrossRefPubMed Saturno P, Martinez-Nicholas I, Robles-García I, López-Soriano F, Angel-garcia D. Development and pilot test of a new set of good practice indicators for chronic cancer pain management. Eur J Pain. 2015;19(1):28–38.CrossRefPubMed
25.
go back to reference Saturno-Hernández PJ, Martínez-Nicolás I, Poblano-Verástegui O, Vértiz-Ramírez JJ, Suárez-Ortíz C, Magaña-Izquierdo M, Kawa-Karasik S. Implementación de indicadores de calidad de la atención en hospitales públicos de tercer nivel en México. Salud Publica Mex. 2017;59:227–35.CrossRefPubMed Saturno-Hernández PJ, Martínez-Nicolás I, Poblano-Verástegui O, Vértiz-Ramírez JJ, Suárez-Ortíz C, Magaña-Izquierdo M, Kawa-Karasik S. Implementación de indicadores de calidad de la atención en hospitales públicos de tercer nivel en México. Salud Publica Mex. 2017;59:227–35.CrossRefPubMed
26.
go back to reference Saturno PJ, Soria-Aledo V, Da Silva Gama ZA, et al. Understanding WHO surgical checklist implementation: tricks and pitfalls. An observational study. World J Surg. 2014;38:287.CrossRefPubMed Saturno PJ, Soria-Aledo V, Da Silva Gama ZA, et al. Understanding WHO surgical checklist implementation: tricks and pitfalls. An observational study. World J Surg. 2014;38:287.CrossRefPubMed
27.
28.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for Percepción dates. Biometrics. 1977;33(1):159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for Percepción dates. Biometrics. 1977;33(1):159–74.CrossRefPubMed
29.
go back to reference Feinstein AR, Cicchetti DV. High but low kappa agreement: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543–9.CrossRefPubMed Feinstein AR, Cicchetti DV. High but low kappa agreement: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543–9.CrossRefPubMed
30.
go back to reference Consellería de Sanidade. Xunta de Galizia. España; Organización Panamericana de la Salud (OPS-OMS); Universidad CES. Colombia. Epidat: programa para análisis epidemiológico de datos. 2014. http://dxsp.sergas.es/. Accessed 15 Oct 2017. Consellería de Sanidade. Xunta de Galizia. España; Organización Panamericana de la Salud (OPS-OMS); Universidad CES. Colombia. Epidat: programa para análisis epidemiológico de datos. 2014. http://​dxsp.​sergas.​es/​. Accessed 15 Oct 2017.
31.
go back to reference StataCorp. Stata statistical software: 13 release. College Station: StataCorp LP; 2013. StataCorp. Stata statistical software: 13 release. College Station: StataCorp LP; 2013.
32.
go back to reference Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs. 2003;42(1):57–63.CrossRefPubMed Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs. 2003;42(1):57–63.CrossRefPubMed
33.
go back to reference World Health Organization. Strategies toward ending preventable maternal mortality (EPMM). Geneva: World Health Organization; 2015. p. 44. World Health Organization. Strategies toward ending preventable maternal mortality (EPMM). Geneva: World Health Organization; 2015. p. 44.
34.
go back to reference Stelfox HT, Straus SE. Measuring quality of care: considering conceptual approaches to indicator development and evaluation quality. J Clin Epidemiol. 2013;66(12):1328–37.CrossRefPubMed Stelfox HT, Straus SE. Measuring quality of care: considering conceptual approaches to indicator development and evaluation quality. J Clin Epidemiol. 2013;66(12):1328–37.CrossRefPubMed
35.
go back to reference Mainz J. Developing evidence-based clinical indicators: state of the art methods first. Int J Qual Health Care. 2003;15(Suppl 1):i5–11.CrossRefPubMed Mainz J. Developing evidence-based clinical indicators: state of the art methods first. Int J Qual Health Care. 2003;15(Suppl 1):i5–11.CrossRefPubMed
36.
go back to reference Rubin HR, Pronovost P, Diette GB. From a process of care measure to: the development and testing of a quality indicator. Int J Qual Health Care. 2001;13(6):489–96.CrossRefPubMed Rubin HR, Pronovost P, Diette GB. From a process of care measure to: the development and testing of a quality indicator. Int J Qual Health Care. 2001;13(6):489–96.CrossRefPubMed
37.
go back to reference Hurtado MP, Swift EK, Corrigan JM, editors. Envisioning the National Health Care Quality Report. Washington: Institute of Medicine, National Academies Press; 2001. Hurtado MP, Swift EK, Corrigan JM, editors. Envisioning the National Health Care Quality Report. Washington: Institute of Medicine, National Academies Press; 2001.
38.
go back to reference World Health Organization. Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. Geneva: World Health Organization; 2010. World Health Organization. Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. Geneva: World Health Organization; 2010.
Metadata
Title
Construction and pilot test of a set of indicators to assess the implementation and effectiveness of the who safe childbirth checklist
Authors
Pedro J. Saturno-Hernández
María Fernández-Elorriaga
Ismael Martínez-Nicolás
Ofelia Poblano-Verástegui
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Pregnancy and Childbirth / Issue 1/2018
Electronic ISSN: 1471-2393
DOI
https://doi.org/10.1186/s12884-018-1797-y

Other articles of this Issue 1/2018

BMC Pregnancy and Childbirth 1/2018 Go to the issue