Skip to main content
Top
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Research

A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomised controlled international trial: an exemplar

Authors: Jo Rycroft-Malone, Kate Seers, Ann Catrine Eldh, Karen Cox, Nicola Crichton, Gill Harvey, Claire Hawkes, Alison Kitson, Brendan McCormack, Christel McMullan, Carole Mockford, Theo Niessen, Paul Slater, Angie Titchen, Teatske van der Zijpp, Lars Wallin

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

Facilitation is a promising implementation intervention, which requires theory-informed evaluation. This paper presents an exemplar of a multi-country realist process evaluation that was embedded in the first international randomised controlled trial evaluating two types of facilitation for implementing urinary continence care recommendations. We aimed to uncover what worked (and did not work), for whom, how, why and in what circumstances during the process of implementing the facilitation interventions in practice.

Methods

This realist process evaluation included theory formulation, theory testing and refining. Data were collected in 24 care home sites across four European countries. Data were collected over four time points using multiple qualitative methods: observation (372 h), interviews with staff (n = 357), residents (n = 152), next of kin (n = 109) and other stakeholders (n = 128), supplemented by facilitator activity logs. A combined inductive and deductive data analysis process focused on realist theory refinement and testing.

Results

The content and approach of the two facilitation programmes prompted variable opportunities to align and realign support with the needs and expectations of facilitators and homes. This influenced their level of confidence in fulfilling the facilitator role and ability to deliver the intervention as planned. The success of intervention implementation was largely dependent on whether sites prioritised their involvement in both the study and the facilitation programme. In contexts where the study was prioritised (including release of resources) and where managers and staff support was sustained, this prompted collective engagement (as an attitude and action). Internal facilitators’ (IF) personal characteristics and abilities, including personal and formal authority, in combination with a supportive environment prompted by managers triggered the potential for learning over time. Learning over time resulted in a sense of confidence and personal growth, and enactment of the facilitation role, which resulted in practice changes.

Conclusion

The scale and multi-country nature of this study provided a novel context to conduct one of the few trial embedded realist-informed process evaluations. In addition to providing an explanatory account of implementation processes, a conceptual platform for future facilitation research is presented. Finally, a realist-informed process evaluation framework is outlined, which could inform future research of this nature.

Trial registration

Current controlled trials ISRCTN11598502.
Literature
1.
go back to reference Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10:63–74.CrossRef Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10:63–74.CrossRef
2.
go back to reference Dogherty EJ, Harrison M, Graham I, Keeping-Burke L. Examining the use of facilitation within guideline dissemination and implementation studies in nursing. Int J Evid-Based Healthcare. 2014;12(2):105–27.CrossRef Dogherty EJ, Harrison M, Graham I, Keeping-Burke L. Examining the use of facilitation within guideline dissemination and implementation studies in nursing. Int J Evid-Based Healthcare. 2014;12(2):105–27.CrossRef
3.
go back to reference Persson LA, Nga NT, Malqvist M, Thi Phuong Hoa D, Eriksson L, Wallin L, et al. Effect of facilitation of local maternal and newborn stakeholder groups on neonatal mortality: cluster randomised controlled trial. PLoS Med. 2013;10:5.CrossRef Persson LA, Nga NT, Malqvist M, Thi Phuong Hoa D, Eriksson L, Wallin L, et al. Effect of facilitation of local maternal and newborn stakeholder groups on neonatal mortality: cluster randomised controlled trial. PLoS Med. 2013;10:5.CrossRef
4.
go back to reference Berta W, Cranley L, Dearing JW, Dogherty EJ, Squires JE, Estabrooks CA. Why (we think) facilitation works: insights from organisational learning theory. BMC Imp Sci. 2015;10:141. Berta W, Cranley L, Dearing JW, Dogherty EJ, Squires JE, Estabrooks CA. Why (we think) facilitation works: insights from organisational learning theory. BMC Imp Sci. 2015;10:141.
5.
go back to reference Seers K, Cox K, Crichton N, Edwards R, Eldh A, Estabrooks C, et al. FIRE (facilitating implementation of research evidence): a study protocol. BMC Imp Sci. 2012;7:25. Seers K, Cox K, Crichton N, Edwards R, Eldh A, Estabrooks C, et al. FIRE (facilitating implementation of research evidence): a study protocol. BMC Imp Sci. 2012;7:25.
6.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonnell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRef Moore GF, Audrey S, Barker M, Bond L, Bonnell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRef
8.
go back to reference Pinnock H, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, et al. Standards for reporting implementation studies (StaRI). BMJ. 2017;356:i6795.CrossRef Pinnock H, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, et al. Standards for reporting implementation studies (StaRI). BMJ. 2017;356:i6795.CrossRef
9.
go back to reference Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997. Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997.
10.
go back to reference Pawson P. The science of evaluation: a realist manifesto. London: Sage; 2013.CrossRef Pawson P. The science of evaluation: a realist manifesto. London: Sage; 2013.CrossRef
11.
go back to reference Bonell C, Fletcher A, Morton A, Lorenc T, Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75:2299–306.CrossRef Bonell C, Fletcher A, Morton A, Lorenc T, Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75:2299–306.CrossRef
12.
go back to reference Marchal B, Westrop G, Wong G, Van Belle S, Greenhalgh T, Kegels G, et al. Realist RCTs of complex interventions—an oxymoron. Soc Sci Med. 2013;94:124–8.CrossRef Marchal B, Westrop G, Wong G, Van Belle S, Greenhalgh T, Kegels G, et al. Realist RCTs of complex interventions—an oxymoron. Soc Sci Med. 2013;94:124–8.CrossRef
13.
go back to reference Van Belle S, Wong G, Westrop G, Pearson M, Emmel N, Manzano A, et al. Can “realist” randomised controlled trials be genuinely realist? BMC Trials. 2016;17:313.CrossRef Van Belle S, Wong G, Westrop G, Pearson M, Emmel N, Manzano A, et al. Can “realist” randomised controlled trials be genuinely realist? BMC Trials. 2016;17:313.CrossRef
14.
go back to reference Bonell C, Warren E, Fletcher A, Viner R. Realist trials and the testing of context-mechanism-outcome configurations: a response to Van Bell et al. BMC Trials. 2016;17:478.CrossRef Bonell C, Warren E, Fletcher A, Viner R. Realist trials and the testing of context-mechanism-outcome configurations: a response to Van Bell et al. BMC Trials. 2016;17:478.CrossRef
15.
go back to reference Byng R, Norman I, Redfern S, Jones R. Exposing the key functions of a complex intervention for shared care in mental health: case study of a process evaluation. BMC Health Serv Res. 2008;8:274.CrossRef Byng R, Norman I, Redfern S, Jones R. Exposing the key functions of a complex intervention for shared care in mental health: case study of a process evaluation. BMC Health Serv Res. 2008;8:274.CrossRef
16.
go back to reference Masterson-Algar P, Burton CR, Rycroft-Malone J, Sackley C, Walker MF. Towards a programme theory for fidelity in the evaluation of complex evaluations. J Eval Clin Pract. 2014;20(4):445–52.CrossRef Masterson-Algar P, Burton CR, Rycroft-Malone J, Sackley C, Walker MF. Towards a programme theory for fidelity in the evaluation of complex evaluations. J Eval Clin Pract. 2014;20(4):445–52.CrossRef
17.
go back to reference Randall R, Honey S, Hindmarsh J, Alvarado N, Greenhalgh J, Pearman L, et al. A realist process evaluation of robot-assisted surgery: integration into routine practice and impacts on communication, collaboration and decision-making. Health Serv Del Res. 2017;5:20. ISSN 2050 Randall R, Honey S, Hindmarsh J, Alvarado N, Greenhalgh J, Pearman L, et al. A realist process evaluation of robot-assisted surgery: integration into routine practice and impacts on communication, collaboration and decision-making. Health Serv Del Res. 2017;5:20. ISSN 2050
18.
go back to reference Seers K, Rycroft-Malone J, Cox K, Crichton N, Edwards RT, Eldh AC, et al. Facilitating Implementation of Research Evidence (FIRE): a cluster randomised controlled trial to evaluate two models of facilitation informed by the Promoting Action in Research Implementation in Health Services (PARIHS) framework. In review BMC Imp Sci. https://doi.org/10.1186/s13012-018-0831-9. Seers K, Rycroft-Malone J, Cox K, Crichton N, Edwards RT, Eldh AC, et al. Facilitating Implementation of Research Evidence (FIRE): a cluster randomised controlled trial to evaluate two models of facilitation informed by the Promoting Action in Research Implementation in Health Services (PARIHS) framework. In review BMC Imp Sci. https://​doi.​org/​10.​1186/​s13012-018-0831-9.
19.
go back to reference Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. BMC Imp Sci. 2015;10:49. Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. BMC Imp Sci. 2015;10:49.
20.
go back to reference Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A. An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004;13:913–24.CrossRef Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A. An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004;13:913–24.CrossRef
21.
go back to reference Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, et al. Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002;37:577–88.CrossRef Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, et al. Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002;37:577–88.CrossRef
22.
go back to reference Pearson M, Brand SL, Quinn C, Shaw J, Maguire M, Michie S, et al. Using realist review to inform intervention development: methodological illustration and conceptual platform for collaborative care in offender mental health. BMC Imp Sci. 2015;10:134. Pearson M, Brand SL, Quinn C, Shaw J, Maguire M, Michie S, et al. Using realist review to inform intervention development: methodological illustration and conceptual platform for collaborative care in offender mental health. BMC Imp Sci. 2015;10:134.
23.
go back to reference Rycroft-Malone J, Burton CR, Williams L, Edwards S, Fisher D, Hall B, et al. Improving skills and care standards in the support workforce for older people: a realist synthesis of workforce development interventions. Health Serv Deliv Res. 2016;4:12.CrossRef Rycroft-Malone J, Burton CR, Williams L, Edwards S, Fisher D, Hall B, et al. Improving skills and care standards in the support workforce for older people: a realist synthesis of workforce development interventions. Health Serv Deliv Res. 2016;4:12.CrossRef
24.
go back to reference Spradley JP. Participant observation. Illinois: Waveland Press; 1980. Spradley JP. Participant observation. Illinois: Waveland Press; 1980.
25.
go back to reference van der Zijpp TJ, Niessen T, Eldh AC, Hawkes C, McMullan C, Mockford C, Wallin L, et al. A bridge over turbulent waters: illustrating the interaction between managerial leaders and facilitators when implementing research evidence. Worldview Evid-Based Nurs. 2016;13:25–31.CrossRef van der Zijpp TJ, Niessen T, Eldh AC, Hawkes C, McMullan C, Mockford C, Wallin L, et al. A bridge over turbulent waters: illustrating the interaction between managerial leaders and facilitators when implementing research evidence. Worldview Evid-Based Nurs. 2016;13:25–31.CrossRef
26.
go back to reference Tistad M, Palmcrantz S, Wallin L, Ehrenberg A, Olsson CB, Tomson G, et al. Developing leadership in managers to facilitate implementation of national guideline recommendations: a process evaluation of feasibility and usefulness. Int J Health Pol Man. 2016;5(8):477–86.CrossRef Tistad M, Palmcrantz S, Wallin L, Ehrenberg A, Olsson CB, Tomson G, et al. Developing leadership in managers to facilitate implementation of national guideline recommendations: a process evaluation of feasibility and usefulness. Int J Health Pol Man. 2016;5(8):477–86.CrossRef
27.
go back to reference Mekki TE, Øye C, Kristensen B, Dahl H, Haaland A, Nordin KA, et al. The inter-play between facilitation and context in the promoting action on research implementation in health services framework: a qualitative exploratory implementation study embedded in a cluster randomized controlled trial to reduce restraint in nursing homes. J Adv Nurs. 2017;73(11):2622–32.CrossRef Mekki TE, Øye C, Kristensen B, Dahl H, Haaland A, Nordin KA, et al. The inter-play between facilitation and context in the promoting action on research implementation in health services framework: a qualitative exploratory implementation study embedded in a cluster randomized controlled trial to reduce restraint in nursing homes. J Adv Nurs. 2017;73(11):2622–32.CrossRef
28.
go back to reference Eriksson L, Huy TQ, Duc DM, Ekholm Selling K, Hoa DP, Thuy NT, et al. Process evaluation of a knowledge translation intervention using facilitation of local stakeholder groups to improve neonatal survival in the Quang Ninh province. Vietnam BMC Trials. 2016;17:23.CrossRef Eriksson L, Huy TQ, Duc DM, Ekholm Selling K, Hoa DP, Thuy NT, et al. Process evaluation of a knowledge translation intervention using facilitation of local stakeholder groups to improve neonatal survival in the Quang Ninh province. Vietnam BMC Trials. 2016;17:23.CrossRef
29.
go back to reference May C, Finch T. Implementing, embedding and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.CrossRef May C, Finch T. Implementing, embedding and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.CrossRef
30.
go back to reference McCormack B, Rycroft-Malone J, DeCorby K, Hutchinson AM, Bucknall T, Kent B, et al. A realist review of intervention and strategies to promote evidence-informed healthcare: a focus on change agency. BMC Imp Sci. 2013;8:107. McCormack B, Rycroft-Malone J, DeCorby K, Hutchinson AM, Bucknall T, Kent B, et al. A realist review of intervention and strategies to promote evidence-informed healthcare: a focus on change agency. BMC Imp Sci. 2013;8:107.
31.
go back to reference Fay B. Critical social science—liberation and its limits. NY: Cornell University Press; 1987. Fay B. Critical social science—liberation and its limits. NY: Cornell University Press; 1987.
32.
go back to reference Hawe P, Sheill A, Riley T. Complex interventions: how ‘out of control’ can a randomised controlled trial be? BMJ. 2004;328(7455):1561–3.CrossRef Hawe P, Sheill A, Riley T. Complex interventions: how ‘out of control’ can a randomised controlled trial be? BMJ. 2004;328(7455):1561–3.CrossRef
33.
go back to reference Rycroft-Malone J, Fontenla M, Bick D, Seers K. A realistic evaluation: the case of protocol-based care. BMC Imp Sci. 2010;5:38. Rycroft-Malone J, Fontenla M, Bick D, Seers K. A realistic evaluation: the case of protocol-based care. BMC Imp Sci. 2010;5:38.
34.
go back to reference Rycroft-Malone J, Burton CR, Wilkinson J, Harvey G, McCormack B, Baker R, et al. Collective action for implementation: a realist evaluation of organisational collaboration in healthcare. BMC Imp Sci. 2016;11:17. Rycroft-Malone J, Burton CR, Wilkinson J, Harvey G, McCormack B, Baker R, et al. Collective action for implementation: a realist evaluation of organisational collaboration in healthcare. BMC Imp Sci. 2016;11:17.
35.
go back to reference Harvey G, McCormack B, Kitson A, Lynch E, Titchen A. Designing and implementing two facilitation interventions within the ‘Facilitating Implementation of Research Evidence (FIRE)’ study: a qualitative analysis from an external facilitators. In review BMC Imp Sci. https://doi.org/10.1186/s13012-018-0812-z. Harvey G, McCormack B, Kitson A, Lynch E, Titchen A. Designing and implementing two facilitation interventions within the ‘Facilitating Implementation of Research Evidence (FIRE)’ study: a qualitative analysis from an external facilitators. In review BMC Imp Sci. https://​doi.​org/​10.​1186/​s13012-018-0812-z.
Metadata
Title
A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomised controlled international trial: an exemplar
Authors
Jo Rycroft-Malone
Kate Seers
Ann Catrine Eldh
Karen Cox
Nicola Crichton
Gill Harvey
Claire Hawkes
Alison Kitson
Brendan McCormack
Christel McMullan
Carole Mockford
Theo Niessen
Paul Slater
Angie Titchen
Teatske van der Zijpp
Lars Wallin
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0811-0

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue