Skip to main content
Top
Published in: BMC Health Services Research 1/2008

Open Access 01-12-2008 | Research article

Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives

Authors: Michel LA Dückers, Cordula Wagner, Peter P Groenewegen

Published in: BMC Health Services Research | Issue 1/2008

Login to get access

Abstract

Background

In quality improvement collaboratives (QICs) teams of practitioners from different health care organizations are brought together to systematically improve an aspect of patient care. Teams take part in a series of meetings to learn about relevant best practices, quality methods and change ideas, and share experiences in making changes in their own local setting. The purpose of this study was to develop an instrument for measuring team organization, external change agent support and support from the team's home institution in a Dutch national improvement and dissemination programme for hospitals based on several QICs.

Methods

The exploratory methodological design included two phases: a) content development and assessment, resulting in an instrument with 15 items, and b) field testing (N = 165). Internal consistency reliability was tested via Cronbach's alpha coefficient. Principal component analyses were used to identify underlying constructs. Tests of scaling assumptions according to the multi trait/multi-item matrix, were used to confirm the component structure.

Results

Three components were revealed, explaining 65% of the variability. The components were labelled 'organizational support', 'team organization' and 'external change agent support'. One item not meeting item-scale criteria was removed. This resulted in a 14 item instrument. Scale reliability ranged from 0.77 to 0.91. Internal item consistency and divergent validity were satisfactory.

Conclusion

On the whole, the instrument appears to be a promising tool for assessing team organization and internal and external support during QIC implementation. The psychometric properties were good and warrant application of the instrument for the evaluation of the national programme and similar improvement programmes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lee S, Choi KS: Assessing the factors influencing continuous quality improvement implementation: experience in Korean hospitals. International Journal for Quality in Health Care. 2002, 14: 383-391. 10.1093/intqhc/14.5.383.CrossRefPubMed Lee S, Choi KS: Assessing the factors influencing continuous quality improvement implementation: experience in Korean hospitals. International Journal for Quality in Health Care. 2002, 14: 383-391. 10.1093/intqhc/14.5.383.CrossRefPubMed
2.
go back to reference Berwick DM: Developing and testing changes in delivery of care. Annals of Internal Medicine. 1998, 128: 651-656.CrossRefPubMed Berwick DM: Developing and testing changes in delivery of care. Annals of Internal Medicine. 1998, 128: 651-656.CrossRefPubMed
3.
go back to reference Øvretveit J, Bate P, Cleary P, Cretin S, Gustafson D, McInnes K, McLeod H, Molfenter T, Plsek P, Robert G, Shortell S, Wilson T: Quality collaboratives: lessons from research. Quality and Safety in Health Care. 2002, 11: 345-351. 10.1136/qhc.11.4.345.CrossRefPubMed Øvretveit J, Bate P, Cleary P, Cretin S, Gustafson D, McInnes K, McLeod H, Molfenter T, Plsek P, Robert G, Shortell S, Wilson T: Quality collaboratives: lessons from research. Quality and Safety in Health Care. 2002, 11: 345-351. 10.1136/qhc.11.4.345.CrossRefPubMed
4.
go back to reference Landon BE, Wilson IB, McInnes K, Landrum MB, Hirschhorn L, Marsden PV, Gustafson D, Cleary PD: Effects of a quality improvement collaborative on the outcome of care of patients with HIV infection: the EQHIV study. Annals of Internal Medicine. 2004, 140: 887-896.CrossRefPubMed Landon BE, Wilson IB, McInnes K, Landrum MB, Hirschhorn L, Marsden PV, Gustafson D, Cleary PD: Effects of a quality improvement collaborative on the outcome of care of patients with HIV infection: the EQHIV study. Annals of Internal Medicine. 2004, 140: 887-896.CrossRefPubMed
5.
go back to reference Mittman BS: Creating the evidence base for quality improvement collaboratives. Annals of Internal Medicine. 2004, 140: 897-901.CrossRefPubMed Mittman BS: Creating the evidence base for quality improvement collaboratives. Annals of Internal Medicine. 2004, 140: 897-901.CrossRefPubMed
6.
go back to reference Øvretveit J: What are the best strategies for ensuring quality of hospitals. Health Evidence Network. 2003, Copenhagen, World Health Organization Europe Øvretveit J: What are the best strategies for ensuring quality of hospitals. Health Evidence Network. 2003, Copenhagen, World Health Organization Europe
7.
go back to reference Schellekens W, Rouppe Voort van der M, Van Splunteren P: Stone in the pond: stimulating hospitals to implement evidence based innovations (in Dutch). Medisch Contact. 2003, 35: 1302-1304. Schellekens W, Rouppe Voort van der M, Van Splunteren P: Stone in the pond: stimulating hospitals to implement evidence based innovations (in Dutch). Medisch Contact. 2003, 35: 1302-1304.
8.
go back to reference Dückers MLA, Wagner C, Groenewegen PP: Evaluating the implementation and effects of a multilevel quality collaborative in hospital care. Quality and safety improvement research: methods and research practice from the international quality improvement research network. Edited by: Øvretveit J, Sousa P. 2008, ENSP. UNL. MMC Karolinska Institute, Lisbon, 105-126. Dückers MLA, Wagner C, Groenewegen PP: Evaluating the implementation and effects of a multilevel quality collaborative in hospital care. Quality and safety improvement research: methods and research practice from the international quality improvement research network. Edited by: Øvretveit J, Sousa P. 2008, ENSP. UNL. MMC Karolinska Institute, Lisbon, 105-126.
9.
go back to reference Cohen SG, Bailey DE: What makes teams work: group effectiveness research from the shop floor to the executive suite. Journal of Management. 1997, 23: 239-290. 10.1177/014920639702300303.CrossRef Cohen SG, Bailey DE: What makes teams work: group effectiveness research from the shop floor to the executive suite. Journal of Management. 1997, 23: 239-290. 10.1177/014920639702300303.CrossRef
10.
go back to reference Salas E, Dickinson TL, Converse SA, Tannenbaum SI: Toward an understanding of team performance and training. Teams: their training and performance. Edited by: Swezey RW, Salas E. 1992, Ablex Publishing Corporation, Westport, CT, 3-29. Salas E, Dickinson TL, Converse SA, Tannenbaum SI: Toward an understanding of team performance and training. Teams: their training and performance. Edited by: Swezey RW, Salas E. 1992, Ablex Publishing Corporation, Westport, CT, 3-29.
11.
go back to reference Fried B, Rundall T, Topping S: Groups and teams in health service organizations. Health care management: organization design and behaviour. Edited by: Shortell S, Kalunzny A. 2000, Albany: Delmar, 154-190. Fried B, Rundall T, Topping S: Groups and teams in health service organizations. Health care management: organization design and behaviour. Edited by: Shortell S, Kalunzny A. 2000, Albany: Delmar, 154-190.
12.
go back to reference Meyers PW, Sivakumar K, Nakata C: Implementation of industrial process innovations: factors, effects, and marketing implications. Journal of Product Innovations Management. 1999, 16: 295-311. 10.1016/S0737-6782(98)00044-7.CrossRef Meyers PW, Sivakumar K, Nakata C: Implementation of industrial process innovations: factors, effects, and marketing implications. Journal of Product Innovations Management. 1999, 16: 295-311. 10.1016/S0737-6782(98)00044-7.CrossRef
13.
go back to reference Mills PD, Weeks WB: Characteristics of successful quality improvement teams: lessons from five collaborative projects in the VHA. Jt Comm J Qual Saf. 2004, 30 (3): 152-162.PubMed Mills PD, Weeks WB: Characteristics of successful quality improvement teams: lessons from five collaborative projects in the VHA. Jt Comm J Qual Saf. 2004, 30 (3): 152-162.PubMed
14.
go back to reference Green PL: Improving clinical effectiveness in an integrated care delivery system. Journal for Healthcare Quality. 1998, 20: 4-8.CrossRefPubMed Green PL: Improving clinical effectiveness in an integrated care delivery system. Journal for Healthcare Quality. 1998, 20: 4-8.CrossRefPubMed
15.
go back to reference Gustafson DH, Sainfort F, Eichler M, Adams L, Bisognano M, Steudel H: Developing and testing a model to predict outcomes of organizational change. Health Services Research. 2003, 38: 751-776. 10.1111/1475-6773.00143.CrossRefPubMedPubMedCentral Gustafson DH, Sainfort F, Eichler M, Adams L, Bisognano M, Steudel H: Developing and testing a model to predict outcomes of organizational change. Health Services Research. 2003, 38: 751-776. 10.1111/1475-6773.00143.CrossRefPubMedPubMedCentral
16.
go back to reference Aubert BA, Hamel G: Adoption of smart cards in the medical sector: the Canadian experience. Social Science & Medicine. 2001, 53: 879-894. 10.1016/S0277-9536(00)00388-9.CrossRef Aubert BA, Hamel G: Adoption of smart cards in the medical sector: the Canadian experience. Social Science & Medicine. 2001, 53: 879-894. 10.1016/S0277-9536(00)00388-9.CrossRef
17.
go back to reference Weiner BJ, Shortell SM, Alexander J: Promoting clinical involvement in hospital quality improvement efforts: the effects of top management, board and physician leadership. Health Services Research. 1997, 32: 491-510.PubMedPubMedCentral Weiner BJ, Shortell SM, Alexander J: Promoting clinical involvement in hospital quality improvement efforts: the effects of top management, board and physician leadership. Health Services Research. 1997, 32: 491-510.PubMedPubMedCentral
18.
go back to reference Young GJ: Managing organizational transformations: lessons from the Veterans Health Administration. California Management Review. 2000, 43: 66-83.CrossRef Young GJ: Managing organizational transformations: lessons from the Veterans Health Administration. California Management Review. 2000, 43: 66-83.CrossRef
19.
go back to reference Parry KW: Enhancing adaptability: leadership strategies to accommodate change in local government settings. Journal of Organizational Change Management. 1999, 12: 134-156. 10.1108/09534819910263677.CrossRef Parry KW: Enhancing adaptability: leadership strategies to accommodate change in local government settings. Journal of Organizational Change Management. 1999, 12: 134-156. 10.1108/09534819910263677.CrossRef
20.
go back to reference Reeleeder D, Goel V, Singer PA, Martin DK: Leadership and priority setting: the perspective of hospital CEOs. Health Policy. 2006, 79: 24-34. 10.1016/j.healthpol.2005.11.009.CrossRef Reeleeder D, Goel V, Singer PA, Martin DK: Leadership and priority setting: the perspective of hospital CEOs. Health Policy. 2006, 79: 24-34. 10.1016/j.healthpol.2005.11.009.CrossRef
21.
go back to reference Edmondson AC, Bohmer RM, Pisano GP: Disrupted routines: team learning and new technology implementation in hospitals. Administrative Science Quarterly. 2001, 46: 685-716. 10.2307/3094828.CrossRef Edmondson AC, Bohmer RM, Pisano GP: Disrupted routines: team learning and new technology implementation in hospitals. Administrative Science Quarterly. 2001, 46: 685-716. 10.2307/3094828.CrossRef
22.
go back to reference Sparks JR, Schenk JA: Explaining the effects of transformational leadership: an investigation of the effects of higher-order motives in multilevel marketing organizations. Journal of Organizational Behavior. 2001, 22: 849-869. 10.1002/job.116.CrossRef Sparks JR, Schenk JA: Explaining the effects of transformational leadership: an investigation of the effects of higher-order motives in multilevel marketing organizations. Journal of Organizational Behavior. 2001, 22: 849-869. 10.1002/job.116.CrossRef
23.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3 Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3
24.
go back to reference Campbell DT, Fiske DW: Convergent and discriminant validity by the multitrait-multimethod matrix. Psychological bulletin. 1959, 56: 81-105. 10.1037/h0046016.CrossRefPubMed Campbell DT, Fiske DW: Convergent and discriminant validity by the multitrait-multimethod matrix. Psychological bulletin. 1959, 56: 81-105. 10.1037/h0046016.CrossRefPubMed
25.
go back to reference Karlsson J, Persson L-O, Sjöström L, Sullivan M: Psychometric properties and factor structure of the Three-Factor Eating Questionnaire (TFEQ) in obese men and women. Results from the Swedish Obese Subjects (SOS) study. International Journal of Obesity. 2000, 24: 1715-1725. 10.1038/sj.ijo.0801442.CrossRefPubMed Karlsson J, Persson L-O, Sjöström L, Sullivan M: Psychometric properties and factor structure of the Three-Factor Eating Questionnaire (TFEQ) in obese men and women. Results from the Swedish Obese Subjects (SOS) study. International Journal of Obesity. 2000, 24: 1715-1725. 10.1038/sj.ijo.0801442.CrossRefPubMed
26.
go back to reference Ware JE, Gandek B: Overview of the SF-36 health survey and the international quality of life assessment (IQOLA) project. Journal of Clinical Epidemiology. 1998, 51: 903-912. 10.1016/S0895-4356(98)00081-X.CrossRefPubMed Ware JE, Gandek B: Overview of the SF-36 health survey and the international quality of life assessment (IQOLA) project. Journal of Clinical Epidemiology. 1998, 51: 903-912. 10.1016/S0895-4356(98)00081-X.CrossRefPubMed
27.
go back to reference Kaiser HF: An index of factorial simplicity. Psychometrika. 1974, 39: 31-36. 10.1007/BF02291575.CrossRef Kaiser HF: An index of factorial simplicity. Psychometrika. 1974, 39: 31-36. 10.1007/BF02291575.CrossRef
28.
go back to reference Field A: Discovering statistics using SPSS. 2005, London: sage, second Field A: Discovering statistics using SPSS. 2005, London: sage, second
29.
go back to reference DeVellis RF: Scale development: theory and applications. 2003, Thousand Oaks, CA: Sage DeVellis RF: Scale development: theory and applications. 2003, Thousand Oaks, CA: Sage
30.
go back to reference Russell DW: In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin. 2002, 28: 1629-1646. 10.1177/014616702237645.CrossRef Russell DW: In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin. 2002, 28: 1629-1646. 10.1177/014616702237645.CrossRef
31.
go back to reference Westaway MS, Rheeder P, Van Zyl DG, Seager JR: Interpersonal and organizational dimensions of patient satisfaction: the moderating effects of health status. International Journal for Quality in Health Care. 2003, 15: 337-344. 10.1093/intqhc/mzg042.CrossRefPubMed Westaway MS, Rheeder P, Van Zyl DG, Seager JR: Interpersonal and organizational dimensions of patient satisfaction: the moderating effects of health status. International Journal for Quality in Health Care. 2003, 15: 337-344. 10.1093/intqhc/mzg042.CrossRefPubMed
32.
go back to reference Kass RA, Tinsley HEA: Factor analysis. Journal of Leisure Research. 1979, 11: 120-138. Kass RA, Tinsley HEA: Factor analysis. Journal of Leisure Research. 1979, 11: 120-138.
33.
go back to reference Nunnally JC: Psychometric theory. 1978, New York: McGraw-Hill, second Nunnally JC: Psychometric theory. 1978, New York: McGraw-Hill, second
34.
go back to reference Tabachnik BG, Fidell LS: Using multivariate statistics. 2001, Needham Heights, MA: Allyn and Bacon, fourth Tabachnik BG, Fidell LS: Using multivariate statistics. 2001, Needham Heights, MA: Allyn and Bacon, fourth
35.
go back to reference Comrey AL, Lee HB: A first course in factor analysis. 1992, Hillsdale, NJ: Erlbaum, 2 Comrey AL, Lee HB: A first course in factor analysis. 1992, Hillsdale, NJ: Erlbaum, 2
36.
go back to reference MacCallum RC, Widaman KF, Zhang S, Hong S: Sample size in factor analysis. Psychological Methods. 1999, 4: 84-99. 10.1037/1082-989X.4.1.84.CrossRef MacCallum RC, Widaman KF, Zhang S, Hong S: Sample size in factor analysis. Psychological Methods. 1999, 4: 84-99. 10.1037/1082-989X.4.1.84.CrossRef
37.
go back to reference Guadagnoli E, Velicer WF: Relation of sample size to the stability of component patterns. Psychological Bulletin. 1988, 103: 265-275. 10.1037/0033-2909.103.2.265.CrossRefPubMed Guadagnoli E, Velicer WF: Relation of sample size to the stability of component patterns. Psychological Bulletin. 1988, 103: 265-275. 10.1037/0033-2909.103.2.265.CrossRefPubMed
Metadata
Title
Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives
Authors
Michel LA Dückers
Cordula Wagner
Peter P Groenewegen
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2008
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-8-172

Other articles of this Issue 1/2008

BMC Health Services Research 1/2008 Go to the issue