Skip to main content
Top
Published in: Implementation Science 1/2009

Open Access 01-12-2009 | Research article

Exploring the black box of quality improvement collaboratives: modelling relations between conditions, applied changes and outcomes

Authors: Michel LA Dückers, Peter Spreeuwenberg, Cordula Wagner, Peter P Groenewegen

Published in: Implementation Science | Issue 1/2009

Login to get access

Abstract

Introduction

Despite the popularity of quality improvement collaboratives (QICs) in different healthcare settings, relatively little is known about the implementation process. The objective of the current study is to learn more about relations between relevant conditions for successful implementation of QICs, applied changes, perceived successes, and actual outcomes.

Methods

Twenty-four Dutch hospitals participated in a dissemination programme based on QICs. A questionnaire was sent to 237 leaders of teams who joined 18 different QICs to measure changes in working methods and activities, overall perceived success, team organisation, and supportive conditions. Actual outcomes were extracted from a database with team performance indicator data. Multi-level analyses were conducted to test a number of hypothesised relations within the cross-classified hierarchical structure in which teams are nested within QICs and hospitals.

Results

Organisational and external change agent support is related positively to the number of changed working methods and activities that, if increased, lead to higher perceived success and indicator outcomes scores. Direct and indirect positive relations between conditions and perceived success could be confirmed. Relations between conditions and actual outcomes are weak. Multi-level analyses reveal significant differences in organisational support between hospitals. The relation between perceived successes and actual outcomes is present at QIC level but not at team level.

Discussion

Several of the expected relations between conditions, applied changes and outcomes, and perceived successes could be verified. However, because QICs vary in topic, approach, complexity, and promised advantages, further research is required: first, to understand why some QIC innovations fit better within the context of the units where they are implemented; second, to assess the influence of perceived success and actual outcomes on the further dissemination of projects over new patient groups.
Appendix
Available only for authorised users
Literature
1.
go back to reference Øvretveit J, Bate P, Cleary P, Cretin S, Gustafson D, McInnes K, McLeod H, Molfenter T, Plsek P, Robert G: Quality collaboratives: lessons from research. Quality and Safety in Health Care. 2002, 11: 345-351. 10.1136/qhc.11.4.345.CrossRefPubMed Øvretveit J, Bate P, Cleary P, Cretin S, Gustafson D, McInnes K, McLeod H, Molfenter T, Plsek P, Robert G: Quality collaboratives: lessons from research. Quality and Safety in Health Care. 2002, 11: 345-351. 10.1136/qhc.11.4.345.CrossRefPubMed
2.
go back to reference Ferlie EB, Shortell SM: Improving the quality of health care in the United Kingdom and the United States: a framework for change. The Milbank Quarterly. 2001, 79: 281-315. 10.1111/1468-0009.00206.CrossRefPubMedPubMedCentral Ferlie EB, Shortell SM: Improving the quality of health care in the United Kingdom and the United States: a framework for change. The Milbank Quarterly. 2001, 79: 281-315. 10.1111/1468-0009.00206.CrossRefPubMedPubMedCentral
3.
go back to reference Cretin S, Shortell SM, Keeler EB: An evaluation of collaborative interventions to improve chronic illness care: framework and study design. Evaluation Review. 2004, 28: 28-51. 10.1177/0193841X03256298.CrossRefPubMed Cretin S, Shortell SM, Keeler EB: An evaluation of collaborative interventions to improve chronic illness care: framework and study design. Evaluation Review. 2004, 28: 28-51. 10.1177/0193841X03256298.CrossRefPubMed
4.
go back to reference Mittman BS: Creating the evidence base for quality improvement collaboratives. Annals of Internal Medicine. 2004, 140: 897-901.CrossRefPubMed Mittman BS: Creating the evidence base for quality improvement collaboratives. Annals of Internal Medicine. 2004, 140: 897-901.CrossRefPubMed
5.
go back to reference Øvretveit J: What are the best strategies for ensuring quality of hospitals. Health Evidence Network. 2003, Copenhagen, World Health Organisation Europe Øvretveit J: What are the best strategies for ensuring quality of hospitals. Health Evidence Network. 2003, Copenhagen, World Health Organisation Europe
6.
go back to reference Schouten LMT, Hulscher MEJL, Van Everdingen JJE, Huijsman R, Grol RPTM: Evidence for the impact of quality improvement collaboratives: systematic review. British Medical Journal. 2008, 336: 1491-1494. 10.1136/bmj.39570.749884.BE.CrossRefPubMedPubMedCentral Schouten LMT, Hulscher MEJL, Van Everdingen JJE, Huijsman R, Grol RPTM: Evidence for the impact of quality improvement collaboratives: systematic review. British Medical Journal. 2008, 336: 1491-1494. 10.1136/bmj.39570.749884.BE.CrossRefPubMedPubMedCentral
7.
go back to reference Landon BE, Wilson IB, McInnes K, Landrum MB, Hirschhorn L, Marsden PV, Gustafson D, Cleary PD: Effects of a quality improvement collaborative on the outcome of care of patients with HIV infection: the EQHIV study. Annals of Internal Medicine. 2004, 140: 887-896.CrossRefPubMed Landon BE, Wilson IB, McInnes K, Landrum MB, Hirschhorn L, Marsden PV, Gustafson D, Cleary PD: Effects of a quality improvement collaborative on the outcome of care of patients with HIV infection: the EQHIV study. Annals of Internal Medicine. 2004, 140: 887-896.CrossRefPubMed
10.
go back to reference Dückers M, Makai P, Vos L, Groenewegen P, Wagner C: Longitudinal analysis on the development of hospital quality management systems in the Netherlands. International Journal for Quality in Health Care. 2009, 21: 330-40. 10.1093/intqhc/mzp031.CrossRefPubMed Dückers M, Makai P, Vos L, Groenewegen P, Wagner C: Longitudinal analysis on the development of hospital quality management systems in the Netherlands. International Journal for Quality in Health Care. 2009, 21: 330-40. 10.1093/intqhc/mzp031.CrossRefPubMed
11.
go back to reference Berg M, Meijerink Y, Gras M, Goossensen A, Schellekens W, Haeck J, Kallewaard M, Kingma H: Feasibility first: developing public performance indicators on patient safety and clinical effectiveness for Dutch hospitals. Health Policy. 2005, 75: 59-73. 10.1016/j.healthpol.2005.02.007.CrossRefPubMed Berg M, Meijerink Y, Gras M, Goossensen A, Schellekens W, Haeck J, Kallewaard M, Kingma H: Feasibility first: developing public performance indicators on patient safety and clinical effectiveness for Dutch hospitals. Health Policy. 2005, 75: 59-73. 10.1016/j.healthpol.2005.02.007.CrossRefPubMed
12.
go back to reference Custers T, Arah O, Klazinga N: Is there a business case for quality in the Netherlands? A critical analysis of the recent reforms of the health care system. Health Policy. 2007, 82: 226-239. 10.1016/j.healthpol.2006.09.005.CrossRefPubMed Custers T, Arah O, Klazinga N: Is there a business case for quality in the Netherlands? A critical analysis of the recent reforms of the health care system. Health Policy. 2007, 82: 226-239. 10.1016/j.healthpol.2006.09.005.CrossRefPubMed
13.
go back to reference van de Ven WPMM, Schut FT: Universal mandatory health insurance in the Netherlands: a model for the United States?. Health Affairs. 2008, 27 (3): 771-781. 10.1377/hlthaff.27.3.771.CrossRefPubMed van de Ven WPMM, Schut FT: Universal mandatory health insurance in the Netherlands: a model for the United States?. Health Affairs. 2008, 27 (3): 771-781. 10.1377/hlthaff.27.3.771.CrossRefPubMed
14.
go back to reference Grinten Van der TED: System revision of Dutch health care: an analysis of policy reform (in Dutch). Tijdschrift voor Sociale Geneeskunde. 2007, 84: 227-233. Grinten Van der TED: System revision of Dutch health care: an analysis of policy reform (in Dutch). Tijdschrift voor Sociale Geneeskunde. 2007, 84: 227-233.
15.
go back to reference Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. The Milbank Quarterly. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. The Milbank Quarterly. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
16.
go back to reference Leggatt S, Dwyer J: Factors supporting high performance in health care organisations. 2003, Melbourne, National Institute of Clinical Studies Leggatt S, Dwyer J: Factors supporting high performance in health care organisations. 2003, Melbourne, National Institute of Clinical Studies
17.
go back to reference Dückers MLA, Wagner C, Groenewegen PP: Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives. BMC Health Services Research. 2008, 8: 172-10.1186/1472-6963-8-172.CrossRefPubMedPubMedCentral Dückers MLA, Wagner C, Groenewegen PP: Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives. BMC Health Services Research. 2008, 8: 172-10.1186/1472-6963-8-172.CrossRefPubMedPubMedCentral
18.
go back to reference Cohen SG, Bailey DE: What makes teams work: group effectiveness research from the shop floor to the executive suite. Journal of Management. 1997, 23: 239-290. 10.1177/014920639702300303.CrossRef Cohen SG, Bailey DE: What makes teams work: group effectiveness research from the shop floor to the executive suite. Journal of Management. 1997, 23: 239-290. 10.1177/014920639702300303.CrossRef
19.
go back to reference Salas E, Dickinson TL, Converse SA, Tannenbaum SI: Toward an understanding of team performance and training. Teams: their training and performance. Edited by: Swezey RW, Salas E. 1992, Ablex Publishing Corporation, Westport, CT, 3-29. Salas E, Dickinson TL, Converse SA, Tannenbaum SI: Toward an understanding of team performance and training. Teams: their training and performance. Edited by: Swezey RW, Salas E. 1992, Ablex Publishing Corporation, Westport, CT, 3-29.
20.
go back to reference Fried B, Rundall T, Topping S: Groups and teams in health service organisations. Health care management: organisation design and behaviour. Edited by: Shortell S, Kalunzny A. 2000, Albany: Delmar, 154-190. Fried B, Rundall T, Topping S: Groups and teams in health service organisations. Health care management: organisation design and behaviour. Edited by: Shortell S, Kalunzny A. 2000, Albany: Delmar, 154-190.
21.
go back to reference Meyers PW, Sivakumar K, Nakata C: Implementation of industrial process innovations: factors, effects, and marketing implications. Journal of Product Innovations Management. 1999, 16: 295-311. 10.1016/S0737-6782(98)00044-7.CrossRef Meyers PW, Sivakumar K, Nakata C: Implementation of industrial process innovations: factors, effects, and marketing implications. Journal of Product Innovations Management. 1999, 16: 295-311. 10.1016/S0737-6782(98)00044-7.CrossRef
22.
go back to reference Mills PD, Weeks WB: Characteristics of successful quality improvement teams: lessons from five collaborative projects in the VHA. Joint Commission Journal on Quality and Safety. 2004, 30: 152-162.PubMed Mills PD, Weeks WB: Characteristics of successful quality improvement teams: lessons from five collaborative projects in the VHA. Joint Commission Journal on Quality and Safety. 2004, 30: 152-162.PubMed
23.
go back to reference Green PL: Improving clinical effectiveness in an integrated care delivery system. Journal for Healthcare Quality. 1998, 20: 4-8.CrossRefPubMed Green PL: Improving clinical effectiveness in an integrated care delivery system. Journal for Healthcare Quality. 1998, 20: 4-8.CrossRefPubMed
24.
go back to reference Gustafson DH, Sainfort F, Eichler M, Adams L, Bisognano M, Steudel H: Developing and testing a model to predict outcomes of organisational change. Health Services Research. 2003, 38: 751-776. 10.1111/1475-6773.00143.CrossRefPubMedPubMedCentral Gustafson DH, Sainfort F, Eichler M, Adams L, Bisognano M, Steudel H: Developing and testing a model to predict outcomes of organisational change. Health Services Research. 2003, 38: 751-776. 10.1111/1475-6773.00143.CrossRefPubMedPubMedCentral
25.
go back to reference Aubert BA, Hamel G: Adoption of smart cards in the medical sector: the Canadian experience. Social Science & Medicine. 2001, 53: 879-894. 10.1016/S0277-9536(00)00388-9.CrossRef Aubert BA, Hamel G: Adoption of smart cards in the medical sector: the Canadian experience. Social Science & Medicine. 2001, 53: 879-894. 10.1016/S0277-9536(00)00388-9.CrossRef
26.
go back to reference Weiner BJ, Shortell SM, Alexander J: Promoting clinical involvement in hospital quality improvement efforts: the effects of top management, board and physician leadership. Health Services Research. 1997, 32: 491-510.PubMedPubMedCentral Weiner BJ, Shortell SM, Alexander J: Promoting clinical involvement in hospital quality improvement efforts: the effects of top management, board and physician leadership. Health Services Research. 1997, 32: 491-510.PubMedPubMedCentral
27.
go back to reference Young GJ: Managing organisational transformations: lessons from the Veterans Health Administration. California Management Review. 2000, 43: 66-83.CrossRef Young GJ: Managing organisational transformations: lessons from the Veterans Health Administration. California Management Review. 2000, 43: 66-83.CrossRef
28.
go back to reference Parry KW: Enhancing adaptability: leadership strategies to accommodate change in local government settings. Journal of Organisational Change Management. 1999, 12: 134-156. 10.1108/09534819910263677.CrossRef Parry KW: Enhancing adaptability: leadership strategies to accommodate change in local government settings. Journal of Organisational Change Management. 1999, 12: 134-156. 10.1108/09534819910263677.CrossRef
29.
go back to reference Reeleeder D, Goel V, Singer PA, Martin DK: Leadership and priority setting: the perspective of hospital CEOs. Health Policy. 2006, 79: 24-34. 10.1016/j.healthpol.2005.11.009.CrossRef Reeleeder D, Goel V, Singer PA, Martin DK: Leadership and priority setting: the perspective of hospital CEOs. Health Policy. 2006, 79: 24-34. 10.1016/j.healthpol.2005.11.009.CrossRef
30.
go back to reference Edmondson AC, Bohmer RM, Pisano GP: Disrupted routines: team learning and new technology implementation in hospitals. Administrative Science Quarterly. 2001, 46: 685-716. 10.2307/3094828.CrossRef Edmondson AC, Bohmer RM, Pisano GP: Disrupted routines: team learning and new technology implementation in hospitals. Administrative Science Quarterly. 2001, 46: 685-716. 10.2307/3094828.CrossRef
31.
go back to reference Sparks JR, Schenk JA: Explaining the effects of transformational leadership: an investigation of the effects of higher-order motives in multi-level marketing organisations. Journal of Organisational Behavior. 2001, 22: 849-869. 10.1002/job.116.CrossRef Sparks JR, Schenk JA: Explaining the effects of transformational leadership: an investigation of the effects of higher-order motives in multi-level marketing organisations. Journal of Organisational Behavior. 2001, 22: 849-869. 10.1002/job.116.CrossRef
32.
go back to reference Vos L, Dückers M, Wagner C: Evaluation Better Faster pillar 3: results of an improvement programme for hospitals (in Dutch). 2008, Utrecht: NIVEL Vos L, Dückers M, Wagner C: Evaluation Better Faster pillar 3: results of an improvement programme for hospitals (in Dutch). 2008, Utrecht: NIVEL
34.
go back to reference Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1170-10.1016/S0140-6736(03)14546-1.CrossRef Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1170-10.1016/S0140-6736(03)14546-1.CrossRef
35.
go back to reference van der Weijden T, Grol R: Feedback and reminders. Improving patient care; the implementation of change in clinical practice. Edited by: Grol R, Wensing M, Eccles M. 2005, Edinburgh: Elsevier, 158-172. van der Weijden T, Grol R: Feedback and reminders. Improving patient care; the implementation of change in clinical practice. Edited by: Grol R, Wensing M, Eccles M. 2005, Edinburgh: Elsevier, 158-172.
36.
go back to reference Snijders TAB, Boskers RJ: Multi-level analysis; an introduction to basic and advanced multi-level modeling. 1999, London: Sage Publishers Snijders TAB, Boskers RJ: Multi-level analysis; an introduction to basic and advanced multi-level modeling. 1999, London: Sage Publishers
37.
go back to reference Sobel ME: Asymptotic intervals for indirect effects in structural equations models. Sociological methodology. Edited by: Leinhart S. 1982, San Francisco: Jossey-Bass, 290-312. 10.2307/270723. Sobel ME: Asymptotic intervals for indirect effects in structural equations models. Sociological methodology. Edited by: Leinhart S. 1982, San Francisco: Jossey-Bass, 290-312. 10.2307/270723.
38.
go back to reference Øvretveit J: Action evaluation of health programmes and change: a handbook for a user focused approach. 2002, Oxford: Radcliffe Medical Press Øvretveit J: Action evaluation of health programmes and change: a handbook for a user focused approach. 2002, Oxford: Radcliffe Medical Press
39.
go back to reference Vos L, Dückers MLA, Wagner C, Van Merode GG: A breakthrough collaborative for process redesign: does it work?. Conference abstract, 25th International Society for Quality in Health Care (ISQua), Copenhagen, October, 19-22. 2008 Vos L, Dückers MLA, Wagner C, Van Merode GG: A breakthrough collaborative for process redesign: does it work?. Conference abstract, 25th International Society for Quality in Health Care (ISQua), Copenhagen, October, 19-22. 2008
40.
go back to reference Dückers MLA, Stegeman I, Spreeuwenberg P, Wagner C, Sanders K, Groenewegen PP: Consensus on the leadership of hospital CEOs and it impact on the participation of physicians in improvement projects. Health Policy. 2009, 91: 306-13. 10.1016/j.healthpol.2009.01.003.CrossRefPubMed Dückers MLA, Stegeman I, Spreeuwenberg P, Wagner C, Sanders K, Groenewegen PP: Consensus on the leadership of hospital CEOs and it impact on the participation of physicians in improvement projects. Health Policy. 2009, 91: 306-13. 10.1016/j.healthpol.2009.01.003.CrossRefPubMed
41.
go back to reference Langley GL, Nolan KM, Nolan TW, Norman CL, Provost LP: The improvement guide: a practical approach to enhancing organisational performance. 1996, San Francisco: Jossey-Bass Publishers Langley GL, Nolan KM, Nolan TW, Norman CL, Provost LP: The improvement guide: a practical approach to enhancing organisational performance. 1996, San Francisco: Jossey-Bass Publishers
42.
go back to reference Berwick DM: Developing and testing changes in delivery of care. Annals of Internal Medicine. 1998, 128: 651-656.CrossRefPubMed Berwick DM: Developing and testing changes in delivery of care. Annals of Internal Medicine. 1998, 128: 651-656.CrossRefPubMed
Metadata
Title
Exploring the black box of quality improvement collaboratives: modelling relations between conditions, applied changes and outcomes
Authors
Michel LA Dückers
Peter Spreeuwenberg
Cordula Wagner
Peter P Groenewegen
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2009
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-4-74

Other articles of this Issue 1/2009

Implementation Science 1/2009 Go to the issue