Skip to main content
Top
Published in: BMC Health Services Research 1/2024

Open Access 01-12-2024 | Research

Implementation of large, multi-site hospital interventions: a realist evaluation of strategies for developing capability

Authors: Janet C Long, Natalie Roberts, Emilie Francis-Auton, Mitchell N Sarkies, Hoa Mi Nguyen, Johanna I Westbrook, Jean-Frederic Levesque, Diane E Watson, Rebecca Hardwick, Kate Churruca, Peter Hibbert, Jeffrey Braithwaite

Published in: BMC Health Services Research | Issue 1/2024

Login to get access

Abstract

Background

This study presents guidelines for implementation distilled from the findings of a realist evaluation. The setting was local health districts in New South Wales, Australia that implemented three clinical improvement initiatives as part of a state-wide program. We focussed on implementation strategies designed to develop health professionals’ capability to deliver value-based care initiatives for multisite programs. Capability, which increases implementers’ ability to cope with unexpected scenarios is key to managing change.

Methods

We used a mixed methods realist evaluation which tested and refined program theories elucidating the complex dynamic between context (C), mechanism (M) and outcome (O) to determine what works, for whom, under what circumstances. Data was drawn from program documents, a realist synthesis, informal discussions with implementation designers, and interviews with 10 key informants (out of 37 identified) from seven sites. Data analysis employed a retroductive approach to interrogate the causal factors identified as contributors to outcomes.

Results

CMO statements were refined for four initial program theories: Making it Relevant– where participation in activities was increased when targeted to the needs of the staff; Investment in Quality Improvement– where engagement in capability development was enhanced when it was valued by all levels of the organisation; Turnover and Capability Loss– where the effects of staff turnover were mitigated; and Community-Wide Priority– where there was a strategy of spanning sites. From these data five guiding principles for implementers were distilled: (1) Involve all levels of the health system to effectively implement large-scale capability development, (2) Design capability development activities in a way that supports a learning culture, (3) Plan capability development activities with staff turnover in mind, (4) Increased capability should be distributed across teams to avoid bottlenecks in workflows and the risk of losing key staff, (5) Foster cross-site collaboration to focus effort, reduce variation in practice and promote greater cohesion in patient care.

Conclusions

A key implementation strategy for interventions to standardise high quality practice is development of clinical capability. We illustrate how leadership support, attention to staff turnover patterns, and making activities relevant to current issues, can lead to an emergent learning culture.
Appendix
Available only for authorised users
Literature
1.
go back to reference Corallo AN, Croxford R, Goodman DC, et al. A systematic review of medical practice variation in OECD countries. Health Policy. 2014;114(1):5–14.CrossRefPubMed Corallo AN, Croxford R, Goodman DC, et al. A systematic review of medical practice variation in OECD countries. Health Policy. 2014;114(1):5–14.CrossRefPubMed
3.
go back to reference Sutherland K, Levesque JF. Unwarranted clinical variation in health care: definitions and proposal of an analytic framework. J Eval Clin Pract. 2020;26(3):687–96.CrossRefPubMed Sutherland K, Levesque JF. Unwarranted clinical variation in health care: definitions and proposal of an analytic framework. J Eval Clin Pract. 2020;26(3):687–96.CrossRefPubMed
4.
go back to reference Bottle A, Mariscalco G, Shaw MA, et al. Unwarranted variation in the quality of care for patients with diseases of the thoracic aorta. J Am Heart Association. 2017;6(3):e004913.CrossRef Bottle A, Mariscalco G, Shaw MA, et al. Unwarranted variation in the quality of care for patients with diseases of the thoracic aorta. J Am Heart Association. 2017;6(3):e004913.CrossRef
5.
go back to reference Mercuri M, Gafni A. Medical practice variations: what the literature tells us (or does not) about what are warranted and unwarranted variations. J Eval Clin Pract. 2011;17(4):671–77.CrossRefPubMed Mercuri M, Gafni A. Medical practice variations: what the literature tells us (or does not) about what are warranted and unwarranted variations. J Eval Clin Pract. 2011;17(4):671–77.CrossRefPubMed
7.
go back to reference Cox R, Kendall M, Molineux M et al. Refining a capability development framework for building successful consumer and staff partnerships in healthcare quality improvement: a coproduced eDelphi study. Health Expect 2022. Cox R, Kendall M, Molineux M et al. Refining a capability development framework for building successful consumer and staff partnerships in healthcare quality improvement: a coproduced eDelphi study. Health Expect 2022.
8.
go back to reference Gould D, Drey N, Berridge E-J. Nurses’ experiences of continuing professional development. Nurse Educ Today. 2007;27(6):602–09.CrossRefPubMed Gould D, Drey N, Berridge E-J. Nurses’ experiences of continuing professional development. Nurse Educ Today. 2007;27(6):602–09.CrossRefPubMed
9.
go back to reference O’Connell J, Gardner G, Coyer F. Beyond competencies: using a capability framework in developing practice standards for advanced practice nursing. J Adv Nurs. 2014;70(12):2728–35.CrossRefPubMed O’Connell J, Gardner G, Coyer F. Beyond competencies: using a capability framework in developing practice standards for advanced practice nursing. J Adv Nurs. 2014;70(12):2728–35.CrossRefPubMed
10.
go back to reference Valderas Martinez J, Ricci-Cabello N, Prasopa-Plazier N, et al. Patient engagement: WHO technical series on safer primary care. World Health Organisation; 2016. Valderas Martinez J, Ricci-Cabello N, Prasopa-Plazier N, et al. Patient engagement: WHO technical series on safer primary care. World Health Organisation; 2016.
11.
go back to reference Hinman RS, Allen KD, Bennell KL, et al. Development of a core capability framework for qualified health professionals to optimise care for people with osteoarthritis: an OARSI initiative. Osteoarthr Cartil. 2020;28(2):154–66.CrossRef Hinman RS, Allen KD, Bennell KL, et al. Development of a core capability framework for qualified health professionals to optimise care for people with osteoarthritis: an OARSI initiative. Osteoarthr Cartil. 2020;28(2):154–66.CrossRef
13.
go back to reference Cairns L, Stephenson J. Capable workplace learning: Brill 2009. Cairns L, Stephenson J. Capable workplace learning: Brill 2009.
15.
go back to reference Mittal S. How organizations implement new practices in dynamic context: role of deliberate learning and dynamic capabilities development in health care units. J Knowl Manage 2019. Mittal S. How organizations implement new practices in dynamic context: role of deliberate learning and dynamic capabilities development in health care units. J Knowl Manage 2019.
16.
go back to reference Kokshagina O. Managing shifts to value-based healthcare and value digitalization as a multi-level dynamic capability development process. Technol Forecast Soc Chang. 2021;172:121072.CrossRef Kokshagina O. Managing shifts to value-based healthcare and value digitalization as a multi-level dynamic capability development process. Technol Forecast Soc Chang. 2021;172:121072.CrossRef
19.
go back to reference Greenhalgh T, Humphrey C, Hughes J, et al. How do you modernize a health service? A realist evaluation of whole-scale transformation in London. Milbank Q. 2009;87(2):391–416.CrossRefPubMedPubMedCentral Greenhalgh T, Humphrey C, Hughes J, et al. How do you modernize a health service? A realist evaluation of whole-scale transformation in London. Milbank Q. 2009;87(2):391–416.CrossRefPubMedPubMedCentral
20.
go back to reference Pawson R, Manzano-Santaella A. A realist diagnostic workshop. Evaluation. 2012;18(2):176–91.CrossRef Pawson R, Manzano-Santaella A. A realist diagnostic workshop. Evaluation. 2012;18(2):176–91.CrossRef
24.
go back to reference Jagosh J. Retroductive theorizing in Pawson and Tilley’s applied scientific realism. J Crit Realism. 2020;19(2):121–30.CrossRef Jagosh J. Retroductive theorizing in Pawson and Tilley’s applied scientific realism. J Crit Realism. 2020;19(2):121–30.CrossRef
31.
go back to reference Francis-Auton E, Long JC, Sarkies M et al. Four System enablers of large System Transformation in Health Care: a mixed methods Realist evaluation. Milbank Q 2023;Accepted Nov 2023. Francis-Auton E, Long JC, Sarkies M et al. Four System enablers of large System Transformation in Health Care: a mixed methods Realist evaluation. Milbank Q 2023;Accepted Nov 2023.
32.
go back to reference Hartviksen TA, Sjolie BM, Aspfors J, et al. Healthcare middle managersexperiences developing leadership capacity and capability in a public funded learning network. BMC Health Serv Res. 2018;18(1):1–11.CrossRef Hartviksen TA, Sjolie BM, Aspfors J, et al. Healthcare middle managersexperiences developing leadership capacity and capability in a public funded learning network. BMC Health Serv Res. 2018;18(1):1–11.CrossRef
33.
go back to reference Hartviksen TA, Aspfors J, Uhrenfeldt L. Healthcare middle managers’ experiences of developing capacity and capability: a systematic review and meta-synthesis. BMC Health Serv Res. 2019;19(1):1–19.CrossRef Hartviksen TA, Aspfors J, Uhrenfeldt L. Healthcare middle managers’ experiences of developing capacity and capability: a systematic review and meta-synthesis. BMC Health Serv Res. 2019;19(1):1–19.CrossRef
Metadata
Title
Implementation of large, multi-site hospital interventions: a realist evaluation of strategies for developing capability
Authors
Janet C Long
Natalie Roberts
Emilie Francis-Auton
Mitchell N Sarkies
Hoa Mi Nguyen
Johanna I Westbrook
Jean-Frederic Levesque
Diane E Watson
Rebecca Hardwick
Kate Churruca
Peter Hibbert
Jeffrey Braithwaite
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2024
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-024-10721-w

Other articles of this Issue 1/2024

BMC Health Services Research 1/2024 Go to the issue