Skip to main content
Top
Published in: Trials 1/2018

Open Access 01-12-2018 | Methodology

Process evaluation for OptiBIRTH, a randomised controlled trial of a complex intervention designed to increase rates of vaginal birth after caesarean section

Authors: Patricia Healy, Valerie Smith, Gerard Savage, Mike Clarke, Declan Devane, Mechthild M. Gross, Sandra Morano, Deirdre Daly, Susanne Grylka-Baeschlin, Jane Nicoletti, Marlene Sinclair, Rebekah Maguire, Margaret Carroll, Cecily Begley

Published in: Trials | Issue 1/2018

Login to get access

Abstract

Background

Complex interventions encompassing several interconnecting and interacting components can be challenging to evaluate. Examining the underlying trial processes while an intervention is being tested can assist in explaining why an intervention was effective (or not). This paper describes a process evaluation of a pan-European cluster randomised controlled trial, OptiBIRTH (undertaken in Ireland, Italy and Germany), that successfully used both quantitative and qualitative methods to enhance understanding of the underlying trial mechanisms and their effect on the trial outcome.

Methods

We carried out a mixed methods process evaluation. Quantitative and qualitative data were collected from observation of the implementation of the intervention in practice to determine whether it was delivered according to the original protocol. Data were examined to assess the delivery of the various components of the intervention and the receipt of the intervention by key stakeholders (pregnant women, midwives, obstetricians). Using ethnography, an exploration of perceived experiences from a range of recipients was conducted to understand the perspective of both those delivering and those receiving the intervention.

Results

Engagement by stakeholders with the different components of the intervention varied from minimal intensity of women’s engagement with antenatal classes, to moderate intensity of engagement with online resources, to high intensity of clinicians’ exposure to the education sessions provided. The ethnography determined that, although the overall culture in the intervention site did not change, smaller, more individual cultural changes were observed. The fidelity of the delivery of the intervention scored average quality marks of 80% and above on repeat assessments.

Conclusion

Nesting a process evaluation within the trial enabled the observation of the mode of action of the intervention in its practice context and ensured that the intervention was delivered with a good level of consistency. Implementation problems were identified as they arose and were addressed accordingly. When dealing with a complex intervention, collecting and analysing both quantitative and qualitative data, as we did, can greatly enhance the process evaluation.

Trial registration

Current Controlled Trials Register, ISRCTN10612254. Registered on 3 April 2013.
Appendix
Available only for authorised users
Literature
2.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J, RIPPLE Study Team. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.CrossRefPubMedPubMedCentral Oakley A, Strange V, Bonell C, Allen E, Stephenson J, RIPPLE Study Team. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.CrossRefPubMedPubMedCentral
4.
go back to reference Hoffmann T, Glasziou P, Boutron I, Milne R, Perera R, Moher D, Altman D, Barbour V, Macdonald H, Johnston M, Lamb S, Dixon-Woods M, McCulloch P, Wyatt J, Chan A, Michie S. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.CrossRefPubMed Hoffmann T, Glasziou P, Boutron I, Milne R, Perera R, Moher D, Altman D, Barbour V, Macdonald H, Johnston M, Lamb S, Dixon-Woods M, McCulloch P, Wyatt J, Chan A, Michie S. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.CrossRefPubMed
6.
go back to reference Ministero della Salute. Sistema Nazionale Linee Guida (SNLG): il taglio cesareo: una scelta appropriata econsapevole. 2012. Ministero della Salute. Sistema Nazionale Linee Guida (SNLG): il taglio cesareo: una scelta appropriata econsapevole. 2012.
7.
go back to reference Clarke M, Savage G, Smith V, Daly D, Devane D, Gross M, et al. Improving the organisation of maternal health service delivery and optimising childbirth by increasing vaginal birth after caesarean section through enhanced women-centred care (OptiBIRTH trial): study protocol for a randomised controlled trial (ISRCTN10612254). Trials. 2015;16:542.CrossRefPubMedPubMedCentral Clarke M, Savage G, Smith V, Daly D, Devane D, Gross M, et al. Improving the organisation of maternal health service delivery and optimising childbirth by increasing vaginal birth after caesarean section through enhanced women-centred care (OptiBIRTH trial): study protocol for a randomised controlled trial (ISRCTN10612254). Trials. 2015;16:542.CrossRefPubMedPubMedCentral
8.
go back to reference Rychetnik L, Frommer M, Hawe P, Shiell A. Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002;56:119–27.CrossRefPubMedPubMedCentral Rychetnik L, Frommer M, Hawe P, Shiell A. Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002;56:119–27.CrossRefPubMedPubMedCentral
9.
go back to reference Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6:134–47.CrossRefPubMed Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6:134–47.CrossRefPubMed
10.
go back to reference Grant A, Treweek S, Dreischulte T, Foy R, Gutherie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.CrossRefPubMedPubMedCentral Grant A, Treweek S, Dreischulte T, Foy R, Gutherie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.CrossRefPubMedPubMedCentral
12.
go back to reference Lundgren I, Begely C, Gross M, Bondas T. ‘Groping through the fog’: VBAC (Vaginal birth after Casearean section) – a meta synthesis about women’s experiences. BMC Pregnancy Childbirth. 2012;12:85.CrossRefPubMedPubMedCentral Lundgren I, Begely C, Gross M, Bondas T. ‘Groping through the fog’: VBAC (Vaginal birth after Casearean section) – a meta synthesis about women’s experiences. BMC Pregnancy Childbirth. 2012;12:85.CrossRefPubMedPubMedCentral
14.
go back to reference Nilsson C, Lundgren I, Smith V, Vehvilinen-Julkunen K, Nicoletti J, Devane D, et al. Women-centred interventions to increase vaginal birth after caesarean section (VBAC): a systematic review. Midwifery. 2015;31:657–63.CrossRefPubMed Nilsson C, Lundgren I, Smith V, Vehvilinen-Julkunen K, Nicoletti J, Devane D, et al. Women-centred interventions to increase vaginal birth after caesarean section (VBAC): a systematic review. Midwifery. 2015;31:657–63.CrossRefPubMed
19.
go back to reference Borrelli B. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. J Public Health Dent. 2011;71 Suppl 1:S52–63.CrossRefPubMedCentral Borrelli B. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. J Public Health Dent. 2011;71 Suppl 1:S52–63.CrossRefPubMedCentral
20.
go back to reference Mowbray CT, Holter MC, Teague GB, Bybee D. Fidelity criteria: development, measurement, and validation. Am J Eval. 2003;24:315–40.CrossRef Mowbray CT, Holter MC, Teague GB, Bybee D. Fidelity criteria: development, measurement, and validation. Am J Eval. 2003;24:315–40.CrossRef
21.
go back to reference Maguire R. “Trying for a VBAC”: an ethnography of cultural change within a randomised trial aimed at increasing vaginal birth after caesarean section: the OptiBIRTH study. Doctoral thesis, University of Dublin, Trinity College Dublin, Ireland; 2016. Maguire R. “Trying for a VBAC”: an ethnography of cultural change within a randomised trial aimed at increasing vaginal birth after caesarean section: the OptiBIRTH study. Doctoral thesis, University of Dublin, Trinity College Dublin, Ireland; 2016.
22.
go back to reference Steckler A, Linnan L, editors. Process evaluation for public health interventions and research. San Francisco: Jossey-Bass; 2002. Steckler A, Linnan L, editors. Process evaluation for public health interventions and research. San Francisco: Jossey-Bass; 2002.
24.
go back to reference Smyth R, Jacoby A, Altman D, Gamble C, Williamson P. The natural history of conducting and reporting clinical trials: interviews with trialists. Trials. 2015;16:16.CrossRefPubMedPubMedCentral Smyth R, Jacoby A, Altman D, Gamble C, Williamson P. The natural history of conducting and reporting clinical trials: interviews with trialists. Trials. 2015;16:16.CrossRefPubMedPubMedCentral
26.
go back to reference Durlak J, DuPre E. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed Durlak J, DuPre E. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed
27.
go back to reference Wells M, Williams B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012;13:95.CrossRefPubMedPubMedCentral Wells M, Williams B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012;13:95.CrossRefPubMedPubMedCentral
29.
go back to reference National Perinatal Epidemiology Unit (NPEU). Delivered with care: a national survey of women’s experience of maternity care. Oxford, UK: NPEU; 2010. National Perinatal Epidemiology Unit (NPEU). Delivered with care: a national survey of women’s experience of maternity care. Oxford, UK: NPEU; 2010.
Metadata
Title
Process evaluation for OptiBIRTH, a randomised controlled trial of a complex intervention designed to increase rates of vaginal birth after caesarean section
Authors
Patricia Healy
Valerie Smith
Gerard Savage
Mike Clarke
Declan Devane
Mechthild M. Gross
Sandra Morano
Deirdre Daly
Susanne Grylka-Baeschlin
Jane Nicoletti
Marlene Sinclair
Rebekah Maguire
Margaret Carroll
Cecily Begley
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Trials / Issue 1/2018
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-2401-x

Other articles of this Issue 1/2018

Trials 1/2018 Go to the issue