Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-06-2015 | Research article

Assessing the performance of maternity care in Europe: a critical exploration of tools and indicators

Authors: Ramón Escuriet, Joanna White, Katrien Beeckman, Lucy Frith, Fatima Leon-Larios, Christine Loytved, Ans Luyben, Marlene Sinclair, Edwin van Teijlingen, and EU COST Action IS0907. ‘Childbirth Cultures, Concerns, and Consequences’

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

This paper critically reviews published tools and indicators currently used to measure maternity care performance within Europe, focusing particularly on whether and how current approaches enable systematic appraisal of processes of minimal (or non-) intervention in support of physiological or “normal birth”. The work formed part of COST Actions IS0907: “Childbirth Cultures, Concerns, and Consequences: Creating a dynamic EU framework for optimal maternity care” (2011-2014) and IS1405: Building Intrapartum Research Through Health - an interdisciplinary whole system approach to understanding and contextualising physiological labour and birth (BIRTH) (2014-). The Actions included the sharing of country experiences with the aim of promoting salutogenic approaches to maternity care.

Methods

A structured literature search was conducted of material published between 2005 and 2013, incorporating research databases, published documents in english in peer-reviewed international journals and indicator databases which measured aspects of health care at a national and pan-national level. Given its emergence from two COST Actions the work, inevitably, focused on Europe, but findings may be relevant to other countries and regions.

Results

A total of 388 indicators were identified, as well as seven tools specifically designed for capturing aspects of maternity care. Intrapartum care was the most frequently measured feature, through the application of process and outcome indicators. Postnatal and neonatal care of mother and baby were the least appraised areas. An over-riding focus on the quantification of technical intervention and adverse or undesirable outcomes was identified. Vaginal birth (no instruments) was occasionally cited as an indicator; besides this measurement few of the 388 indicators were found to be assessing non-intervention or “good” or positive outcomes more generally.

Conclusions

The tools and indicators identified largely enable measurement of technical interventions and undesirable health (or pathological medical) outcomes. A physiological birth generally necessitates few, or no, interventions, yet most of the indicators presently applied fail to capture (a) this phenomenon, and (b) the relationship between different forms and processes of care, mode of birth and good or positive outcomes. A need was identified for indicators which capture non-intervention, reflecting the reality that most births are low-risk, requiring few, if any, technical medical procedures.
Appendix
Available only for authorised users
Literature
1.
go back to reference Donabedian A. Explorations in Quality Assessment and Monitoring Vol. 1. The Definition of Quality and Approaches to Its Assessment. Michigan: Health Administration Press; 1980. Donabedian A. Explorations in Quality Assessment and Monitoring Vol. 1. The Definition of Quality and Approaches to Its Assessment. Michigan: Health Administration Press; 1980.
2.
go back to reference Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15:523–30.CrossRefPubMed Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15:523–30.CrossRefPubMed
3.
go back to reference Pencheon D. The good indicators guide: understanding how to use and choose indicators. London: Association of Public Health Observatories & NHS Institute for Innovation and Improvement; 2008. Pencheon D. The good indicators guide: understanding how to use and choose indicators. London: Association of Public Health Observatories & NHS Institute for Innovation and Improvement; 2008.
6.
go back to reference Murphy PA, Fullerton JT. Measuring outcomes of maternity care: development of an instrument to assess optimality. J Midwifery Womens Health. 2001;46(5):274–84.CrossRefPubMed Murphy PA, Fullerton JT. Measuring outcomes of maternity care: development of an instrument to assess optimality. J Midwifery Womens Health. 2001;46(5):274–84.CrossRefPubMed
7.
go back to reference Devane D, Begley CM, Clarke M, OBoyle C. Evaluating Maternity Care: A core set of outcome measures. Birth. 2007;34(2):164–72.CrossRefPubMed Devane D, Begley CM, Clarke M, OBoyle C. Evaluating Maternity Care: A core set of outcome measures. Birth. 2007;34(2):164–72.CrossRefPubMed
8.
go back to reference EURO-PERISTAT Project with SCPE and EUROCAT. European Perinatal Health Report. Brussels: The Health and care of pregnant women and babies in Europe in 2010; 2013. EURO-PERISTAT Project with SCPE and EUROCAT. European Perinatal Health Report. Brussels: The Health and care of pregnant women and babies in Europe in 2010; 2013.
9.
go back to reference Zeitlin J, Wildman K, Breart G, Alexander S, Barros H, Blondel B, et al. Selecting an indicator set for monitoring and evaluating perinatal health in Europe: criteria, methods and results from the PERISTAT project. Eur J Obstet Gynecol Reprod Biol. 2003;111:S5–S14.CrossRefPubMed Zeitlin J, Wildman K, Breart G, Alexander S, Barros H, Blondel B, et al. Selecting an indicator set for monitoring and evaluating perinatal health in Europe: criteria, methods and results from the PERISTAT project. Eur J Obstet Gynecol Reprod Biol. 2003;111:S5–S14.CrossRefPubMed
10.
go back to reference Lack N, Zeitlin J, Krebs L, Künzel W, Alexander S. Methodological difficulties in the comparison of indicators of perinatal health across Europe. Eur J Obstet Gynecol Reprod Biol. 2003;111:S33–44.CrossRefPubMed Lack N, Zeitlin J, Krebs L, Künzel W, Alexander S. Methodological difficulties in the comparison of indicators of perinatal health across Europe. Eur J Obstet Gynecol Reprod Biol. 2003;111:S33–44.CrossRefPubMed
11.
go back to reference Sheridan M, Sandall J. Measuring the best outcome for the least intervention: Can the Optimality Index-US be applied in the United Kingdom? Midwifery. 2010;26(6):e9–e15.CrossRefPubMed Sheridan M, Sandall J. Measuring the best outcome for the least intervention: Can the Optimality Index-US be applied in the United Kingdom? Midwifery. 2010;26(6):e9–e15.CrossRefPubMed
12.
go back to reference Smith V, Daly D, Lundgren I, Benstoem C, Devane D. Salutogenically focused outcomes in systematic reviews of intrapartum interventions: A systematic review of systematic reviews. Midwifery. 2014;30(4):e151–6.CrossRefPubMed Smith V, Daly D, Lundgren I, Benstoem C, Devane D. Salutogenically focused outcomes in systematic reviews of intrapartum interventions: A systematic review of systematic reviews. Midwifery. 2014;30(4):e151–6.CrossRefPubMed
13.
go back to reference Renfrew MJ, McFadden A, Bastos MH, Campbell J, Channon AA, Cheung NF, et al. Midwifery and quality care: findings from a new evidenceinformed framework for maternal and newborn care. Lancet. 2014;384:1129–45.CrossRefPubMed Renfrew MJ, McFadden A, Bastos MH, Campbell J, Channon AA, Cheung NF, et al. Midwifery and quality care: findings from a new evidenceinformed framework for maternal and newborn care. Lancet. 2014;384:1129–45.CrossRefPubMed
14.
15.
go back to reference Kelley E, Hurst J. Health Care Quality Indicators Project. Conceptual Framework Paper. OECD Health Working Paper No. 23. Paris: Organisation for Economic Cooperation and Development; 2006. Kelley E, Hurst J. Health Care Quality Indicators Project. Conceptual Framework Paper. OECD Health Working Paper No. 23. Paris: Organisation for Economic Cooperation and Development; 2006.
16.
go back to reference Donabedian A. An Introduction to Quality Assurance in Health Care. Oxford: Oxford University Press; 2003. Donabedian A. An Introduction to Quality Assurance in Health Care. Oxford: Oxford University Press; 2003.
17.
go back to reference Mant J. Process versus outcome indicators in the assessment of quality of healthcare. Int J Qual Health Care. 2001;13(6):475–80.CrossRefPubMed Mant J. Process versus outcome indicators in the assessment of quality of healthcare. Int J Qual Health Care. 2001;13(6):475–80.CrossRefPubMed
18.
go back to reference Ronsmans C. How can we measure progress towards improved maternal health? In: De Brouwere V, Van Lerberghe W, editors. Safe motherhood strategies: a review of the evidence. Antwerp: ITG Press; 2001. Ronsmans C. How can we measure progress towards improved maternal health? In: De Brouwere V, Van Lerberghe W, editors. Safe motherhood strategies: a review of the evidence. Antwerp: ITG Press; 2001.
19.
go back to reference Sibanda T, Fox R, Draycott TJ, Mahmood T, Richmond D, Simms R. Intrapartum quality care indicators: a systemic approach for achieving consensus. Eur J Obstet Gynecol Reprod Biol. 2013;166:23–9.CrossRefPubMed Sibanda T, Fox R, Draycott TJ, Mahmood T, Richmond D, Simms R. Intrapartum quality care indicators: a systemic approach for achieving consensus. Eur J Obstet Gynecol Reprod Biol. 2013;166:23–9.CrossRefPubMed
20.
go back to reference Mullen PM. Using performance indicators to improve performance. Health Serv Manage Res. 2004;17:217–28.CrossRefPubMed Mullen PM. Using performance indicators to improve performance. Health Serv Manage Res. 2004;17:217–28.CrossRefPubMed
21.
go back to reference Gibberd R, Hancock S, Howley P, Richards K. Using indicators to quantify the potential to improve the quality of health care. Int J Qual Health Care. 2004;16:i37–43.CrossRefPubMed Gibberd R, Hancock S, Howley P, Richards K. Using indicators to quantify the potential to improve the quality of health care. Int J Qual Health Care. 2004;16:i37–43.CrossRefPubMed
24.
go back to reference Aniuliene R, Blaževičiene A, Riklikiene O. Quality of obstetric services: perspectives of patients, obstetricians, and midwives. Medicina (Kaunas, Lithuania). 2010;47:120–4. Aniuliene R, Blaževičiene A, Riklikiene O. Quality of obstetric services: perspectives of patients, obstetricians, and midwives. Medicina (Kaunas, Lithuania). 2010;47:120–4.
25.
26.
go back to reference de Bruin-Kooistra M, Amelink-Verburg MP, Buitendijk SE, Westert GP. Finding the right indicators for assessing quality midwifery care. Int J Qual Health Care. 2012;24:301–10.CrossRefPubMed de Bruin-Kooistra M, Amelink-Verburg MP, Buitendijk SE, Westert GP. Finding the right indicators for assessing quality midwifery care. Int J Qual Health Care. 2012;24:301–10.CrossRefPubMed
27.
go back to reference Chappell LC, Calderwood C, Kenyon S, Draper ES, Knight M. Understanding patterns in maternity care in the NHS and getting it right. BMJ. 2013;346:f2812.CrossRefPubMed Chappell LC, Calderwood C, Kenyon S, Draper ES, Knight M. Understanding patterns in maternity care in the NHS and getting it right. BMJ. 2013;346:f2812.CrossRefPubMed
29.
go back to reference Faisel H, Pittrof R, El-Hosini M, Habib M, Azzam E. Using standard primipara method to compare the quality of maternity care in Cairo and London. J Obstet Gynaecol. 2009;29:284–7.CrossRefPubMed Faisel H, Pittrof R, El-Hosini M, Habib M, Azzam E. Using standard primipara method to compare the quality of maternity care in Cairo and London. J Obstet Gynaecol. 2009;29:284–7.CrossRefPubMed
30.
go back to reference Hollins Martin C, Fleming V. The birth satisfaction scale. Int J Health Care Qual Assur. 2011;24:124–35.CrossRef Hollins Martin C, Fleming V. The birth satisfaction scale. Int J Health Care Qual Assur. 2011;24:124–35.CrossRef
31.
go back to reference Knight HE, Gurol-Urganci I, Mahmood TA, Templeton A, Richmond D, van der Meulen JH, et al. Evaluating maternity care using national administrative health datasets: How are statistics affected by the quality of data on method of delivery? BMC Health Serv Res. 2013;13:200.CrossRefPubMedPubMedCentral Knight HE, Gurol-Urganci I, Mahmood TA, Templeton A, Richmond D, van der Meulen JH, et al. Evaluating maternity care using national administrative health datasets: How are statistics affected by the quality of data on method of delivery? BMC Health Serv Res. 2013;13:200.CrossRefPubMedPubMedCentral
32.
go back to reference Murray SF, Buller AM, Bewley S, Sandall J. Metrics for monitoring local inequalities in access to maternity care: developing a basket of markers from routinely available data. Qual Saf Health Care. 2010;19, e39.PubMed Murray SF, Buller AM, Bewley S, Sandall J. Metrics for monitoring local inequalities in access to maternity care: developing a basket of markers from routinely available data. Qual Saf Health Care. 2010;19, e39.PubMed
33.
go back to reference Nuti S, Bonini A, Murante AM, Vainieri M. Performance assessment in the maternity pathway in Tuscany region. Health Serv Manage Res. 2009;22:115–21.CrossRefPubMed Nuti S, Bonini A, Murante AM, Vainieri M. Performance assessment in the maternity pathway in Tuscany region. Health Serv Manage Res. 2009;22:115–21.CrossRefPubMed
35.
go back to reference Overgaard C, Fenger-Grøn M, Sandall J. The impact of birthplace on women’s birth experiences and perceptions of care. Soc Sci Med. 2012;74:973–81.CrossRefPubMed Overgaard C, Fenger-Grøn M, Sandall J. The impact of birthplace on women’s birth experiences and perceptions of care. Soc Sci Med. 2012;74:973–81.CrossRefPubMed
36.
37.
go back to reference van Roosmalen J, Zwart J. Severe acute maternal morbidity in high-income countries. Best Pract Res Clin Obstet Gynaecol. 2009;23:297–304.CrossRefPubMed van Roosmalen J, Zwart J. Severe acute maternal morbidity in high-income countries. Best Pract Res Clin Obstet Gynaecol. 2009;23:297–304.CrossRefPubMed
38.
go back to reference Rudman A, Bassam E, Waldenström U. Women's satisfaction with intrapartum care - a pattern approach. J Adv Nurs. 2007;59:474–87.CrossRefPubMed Rudman A, Bassam E, Waldenström U. Women's satisfaction with intrapartum care - a pattern approach. J Adv Nurs. 2007;59:474–87.CrossRefPubMed
40.
go back to reference Tucker J, Mc Vicar A, Pitchforth E, Farmer J, Bryers H. Maternity care models in a remote and rural network: assessing clinical appropriateness and outcome indicators. Qual Saf Health Care. 2010;19:83–9.CrossRefPubMed Tucker J, Mc Vicar A, Pitchforth E, Farmer J, Bryers H. Maternity care models in a remote and rural network: assessing clinical appropriateness and outcome indicators. Qual Saf Health Care. 2010;19:83–9.CrossRefPubMed
41.
go back to reference Turner M. The use of quality control performance charts to analyze cesarean delivery rates nationally. Int J Gynaecol Obstet. 2011;113:175–7.CrossRefPubMed Turner M. The use of quality control performance charts to analyze cesarean delivery rates nationally. Int J Gynaecol Obstet. 2011;113:175–7.CrossRefPubMed
42.
go back to reference Voerman GE, Calsbeek H, Maassen I, Wiegers T, Braspenning J. A systematic approach towards the development of a set of quality indicators for public reporting in community-based maternity care. Midwifery. 2013;29:316–24.CrossRefPubMed Voerman GE, Calsbeek H, Maassen I, Wiegers T, Braspenning J. A systematic approach towards the development of a set of quality indicators for public reporting in community-based maternity care. Midwifery. 2013;29:316–24.CrossRefPubMed
43.
go back to reference WHO Regional Office for Europe. Making Pregnancy Safer. Assessment tool for the quality of hospital care for mothers and newborn babies. Copenhagen: WHO; 2009. WHO Regional Office for Europe. Making Pregnancy Safer. Assessment tool for the quality of hospital care for mothers and newborn babies. Copenhagen: WHO; 2009.
46.
go back to reference van Teijlingen ER, Pitchforth E, Bishop C, Russell EM. Delphi method and nominal group techniques in family planning and reproductive health research. J Fam Plann Reprod Health Care. 2006;32(4):249–52.CrossRefPubMed van Teijlingen ER, Pitchforth E, Bishop C, Russell EM. Delphi method and nominal group techniques in family planning and reproductive health research. J Fam Plann Reprod Health Care. 2006;32(4):249–52.CrossRefPubMed
47.
go back to reference Jairath N, Weinstein J. The Delphi methodology (Part one): A useful administrative approach. Can J Nurs Adm. 1994;7:29–42.PubMed Jairath N, Weinstein J. The Delphi methodology (Part one): A useful administrative approach. Can J Nurs Adm. 1994;7:29–42.PubMed
48.
go back to reference Van Teijlingen ER, Hundley V, Rennie AM, Graham W, Fitzmaurice A. Maternity satisfaction studies and their limitations: “What is, must still be best”. Birth. 2003;30(2):75–82.CrossRefPubMed Van Teijlingen ER, Hundley V, Rennie AM, Graham W, Fitzmaurice A. Maternity satisfaction studies and their limitations: “What is, must still be best”. Birth. 2003;30(2):75–82.CrossRefPubMed
49.
50.
go back to reference Boulkedid R, Sibony O, Goffinet F, Fauconnier A, Branger B, Alberti C. Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel. PLoS One. 2013;6. Boulkedid R, Sibony O, Goffinet F, Fauconnier A, Branger B, Alberti C. Quality Indicators for Continuous Monitoring to Improve Maternal and Infant Health in Maternity Departments: A Modified Delphi Survey of an International Multidisciplinary Panel. PLoS One. 2013;6.
51.
go back to reference Mc Lachlan HL, Forster DA, Rayner J, Lumley J. Is the organisation and structure of hospital postnatal care a barrier to quality care? Findings from a state-wide review in Victoria, Australia. Midwifery. 2008;24(3):358–70.CrossRef Mc Lachlan HL, Forster DA, Rayner J, Lumley J. Is the organisation and structure of hospital postnatal care a barrier to quality care? Findings from a state-wide review in Victoria, Australia. Midwifery. 2008;24(3):358–70.CrossRef
52.
go back to reference Singh R, Trivedi N. Is the caesarean section rate a performance indicators of an obstetric unit? J Matern Fetal Neonatal Med. 2011;24(2):204–7.CrossRefPubMed Singh R, Trivedi N. Is the caesarean section rate a performance indicators of an obstetric unit? J Matern Fetal Neonatal Med. 2011;24(2):204–7.CrossRefPubMed
53.
go back to reference Turner M. The use of quality control performance charts to analyze caesarean delivery rates nationally. Int J Gynecol Obstet. 2011;113(3):175–7.CrossRef Turner M. The use of quality control performance charts to analyze caesarean delivery rates nationally. Int J Gynecol Obstet. 2011;113(3):175–7.CrossRef
54.
go back to reference Betran AP, Torloni MR, Zhang JJ, Gülmezoglu AM and for the WHO Working Group on Caesarean Section. WHO Statement on caesarean section rates. BJOG. 2015; doi: 10.1111/1471-0528.13526 Betran AP, Torloni MR, Zhang JJ, Gülmezoglu AM and for the WHO Working Group on Caesarean Section. WHO Statement on caesarean section rates. BJOG. 2015; doi: 10.​1111/​1471-0528.​13526
55.
go back to reference Bonfill X, Roqué M, Aller MB, Osoria D, Foradada C, Vives A, et al. Development of quality indicators from systematic reviews: the case of hospital delivery. Implement Sci. 2013;8:42.CrossRefPubMedPubMedCentral Bonfill X, Roqué M, Aller MB, Osoria D, Foradada C, Vives A, et al. Development of quality indicators from systematic reviews: the case of hospital delivery. Implement Sci. 2013;8:42.CrossRefPubMedPubMedCentral
56.
go back to reference Enkin M. Beyond the evidence: The complexity of Maternity care. Birth. 2006;33:4.CrossRef Enkin M. Beyond the evidence: The complexity of Maternity care. Birth. 2006;33:4.CrossRef
57.
go back to reference Luyben JG. Mothering the mother. A study of effective content of care during pregnancy from women’s points of view in three European countries, Doctoral thesis. Glasgow: Caledonian University; 2008. Luyben JG. Mothering the mother. A study of effective content of care during pregnancy from women’s points of view in three European countries, Doctoral thesis. Glasgow: Caledonian University; 2008.
58.
go back to reference Bryce J, Arnold F, Blanc A, Hancioglu A, Newby H, Requejo J, et al. Measuring coverage in MNCH: New findings, new strategies, and recommendations for action. PLoS Med. 2013;10(5), e1001423.CrossRefPubMedPubMedCentral Bryce J, Arnold F, Blanc A, Hancioglu A, Newby H, Requejo J, et al. Measuring coverage in MNCH: New findings, new strategies, and recommendations for action. PLoS Med. 2013;10(5), e1001423.CrossRefPubMedPubMedCentral
59.
go back to reference Chappell LC, Calderwood C, Kenyon S, Draper ES, Knight M. Understanding patterns in maternity care in the NHS and getting it right. BMJ. 2013;346:2812.CrossRef Chappell LC, Calderwood C, Kenyon S, Draper ES, Knight M. Understanding patterns in maternity care in the NHS and getting it right. BMJ. 2013;346:2812.CrossRef
60.
go back to reference Santos JV, Correia C, Cabral F, Bernardes J, Costa-Pereira A, Freitas A. Should European perinatal indicators be revised? Eur J Obstet Gynecol. 2013;170(1):85–9.CrossRef Santos JV, Correia C, Cabral F, Bernardes J, Costa-Pereira A, Freitas A. Should European perinatal indicators be revised? Eur J Obstet Gynecol. 2013;170(1):85–9.CrossRef
61.
go back to reference Kathleen NL, Institute of Medicine: Medicare: A Strategy for Quality Assurance. Washington DC: National Academy Press; 1990. Kathleen NL, Institute of Medicine: Medicare: A Strategy for Quality Assurance. Washington DC: National Academy Press; 1990.
62.
go back to reference Symon A, Mackay A, Ruta D. Postnatal quality of life: a pilot study using the Mother-generated Index. J Adv Nurs. 2003;42(1):21–9.CrossRefPubMed Symon A, Mackay A, Ruta D. Postnatal quality of life: a pilot study using the Mother-generated Index. J Adv Nurs. 2003;42(1):21–9.CrossRefPubMed
63.
go back to reference Wiegers TA, Keirse MJ, Berghs GA, van der Zee J. An approach to measuring quality of midwifery care. J Clin Epidemiol. 1996;49:319–25.CrossRefPubMed Wiegers TA, Keirse MJ, Berghs GA, van der Zee J. An approach to measuring quality of midwifery care. J Clin Epidemiol. 1996;49:319–25.CrossRefPubMed
Metadata
Title
Assessing the performance of maternity care in Europe: a critical exploration of tools and indicators
Authors
Ramón Escuriet
Joanna White
Katrien Beeckman
Lucy Frith
Fatima Leon-Larios
Christine Loytved
Ans Luyben
Marlene Sinclair
Edwin van Teijlingen
and EU COST Action IS0907. ‘Childbirth Cultures, Concerns, and Consequences’
Publication date
01-06-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-1151-2

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue