Skip to main content
Top
Published in: Implementation Science 1/2017

Open Access 01-12-2017 | Research

Does a quality improvement campaign accelerate take-up of new evidence? A ten-state cluster-randomized controlled trial of the IHI’s Project JOINTS

Authors: Eric C. Schneider, Melony E. Sorbero, Ann Haas, M. Susan Ridgely, Dmitry Khodyakov, Claude M. Setodji, Gareth Parry, Susan S. Huang, Deborah S. Yokoe, Don Goldmann

Published in: Implementation Science | Issue 1/2017

Login to get access

Abstract

Background

A decade ago, the Institute for Healthcare Improvement pioneered a quality improvement (QI) campaign, leveraging organizational and personal social networks to disseminate new practices. There have been few rigorous studies of the QI campaign approach.

Methods

Project JOINTS (Joining Organizations IN Tackling SSIs) engaged a network of state-based organizations and professionals in a 6-month QI campaign promoting adherence to three new evidence-based practices known to reduce the risk of infection after joint replacement. We conducted a cluster-randomized trial including ten states (five campaign states and five non-campaign states) with 188 hospitals providing joint replacement to Medicare. We measured adherence to the evidence-based practices before and after the campaign using a survey of surgical staff and a difference-in-difference design with multivariable adjustment to compare adherence to each of the relevant practices and an all-or-none composite measure of the three new practices.

Results

In the campaign states, there were statistically significant increases in adherence to the three new evidence-based practices promoted by the campaign. Compared to the non-campaign states, the relative increase in adherence to the three new practices in the campaign states ranged between 1.9 and 15.9 percentage points, but only one of these changes (pre-operative nasal screening for Staphylococcus aureus carriage and decolonization prior to surgery) was statistically significant (p < 0.05). On the all-or-none composite measure, adherence to all three evidence-based practices increased from 19.6 to 37.9% in the campaign states, but declined slightly in the comparison states, yielding a relative increase of 23 percentage points (p = 0.004). In the non-campaign states, changes in adherence were not statistically significant.

Conclusions

Within 6 months, in a cluster-randomized trial, a multi-state campaign targeting hospitals and professionals involved in surgical care and infection control was associated with an increase in adherence to evidence-based practices that can reduce surgical site infection.
Appendix
Available only for authorised users
Literature
1.
go back to reference Davis DA, Taylor-Vaisey A. Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997;157(4):408–16.PubMedPubMedCentral Davis DA, Taylor-Vaisey A. Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997;157(4):408–16.PubMedPubMedCentral
2.
go back to reference Schouten LM, Hulscher ME, van Everdingen JJ, et al. Evidence for the impact of quality improvement collaboratives: systematic review. BMJ. 2008;336(7659):1491–4.CrossRefPubMedPubMedCentral Schouten LM, Hulscher ME, van Everdingen JJ, et al. Evidence for the impact of quality improvement collaboratives: systematic review. BMJ. 2008;336(7659):1491–4.CrossRefPubMedPubMedCentral
3.
go back to reference Nadeem E, Olin SS, Hill LC, et al. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91(2):354–94.CrossRefPubMedPubMedCentral Nadeem E, Olin SS, Hill LC, et al. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91(2):354–94.CrossRefPubMedPubMedCentral
4.
go back to reference Hulscher ME, Schouten LM, Grol RP, et al. Determinants of success of quality improvement collaboratives: what does the literature show? BMJ Qual Saf. 2013;22(1):19–31.CrossRefPubMed Hulscher ME, Schouten LM, Grol RP, et al. Determinants of success of quality improvement collaboratives: what does the literature show? BMJ Qual Saf. 2013;22(1):19–31.CrossRefPubMed
5.
6.
go back to reference McCannon CJ, Hackbarth AD, Griffin FA. Miles to go: an introduction to the 5 Million Lives Campaign. Jt Comm J Qual Patient Saf. 2007;33(8):477–84.CrossRefPubMed McCannon CJ, Hackbarth AD, Griffin FA. Miles to go: an introduction to the 5 Million Lives Campaign. Jt Comm J Qual Patient Saf. 2007;33(8):477–84.CrossRefPubMed
9.
go back to reference McCannon C, Perla R. Learning networks for sustainable, large-scale improvement. Jt Comm J Qual Patient Saf. 2009;35(5):286–91.CrossRefPubMed McCannon C, Perla R. Learning networks for sustainable, large-scale improvement. Jt Comm J Qual Patient Saf. 2009;35(5):286–91.CrossRefPubMed
10.
go back to reference Wachter RM, Pronovost PJ. The 100,000 lives campaign: a scientific and policy review. Jt Comm J Qual Patient Saf. 2006;32(11):621–7.CrossRefPubMed Wachter RM, Pronovost PJ. The 100,000 lives campaign: a scientific and policy review. Jt Comm J Qual Patient Saf. 2006;32(11):621–7.CrossRefPubMed
11.
go back to reference Schwamm LH, Fonarow GC, Reeves MJ, et al. Get With the Guidelines-Stroke is associated with sustained improvement in care for patients hospitalized with acute stroke or transient ischemic attack. Circulation. 2009;119(1):107–15.CrossRefPubMed Schwamm LH, Fonarow GC, Reeves MJ, et al. Get With the Guidelines-Stroke is associated with sustained improvement in care for patients hospitalized with acute stroke or transient ischemic attack. Circulation. 2009;119(1):107–15.CrossRefPubMed
12.
go back to reference Nallamothu BK, Krumholz HM, Peterson ED, et al. Door-to-balloon times in hospitals within the get-with-the-guidelines registry after initiation of the Door-to-Balloon (D2B) Alliance. Am J Cardiol. 2009;103(8):1051–5.CrossRefPubMed Nallamothu BK, Krumholz HM, Peterson ED, et al. Door-to-balloon times in hospitals within the get-with-the-guidelines registry after initiation of the Door-to-Balloon (D2B) Alliance. Am J Cardiol. 2009;103(8):1051–5.CrossRefPubMed
13.
go back to reference Khodyakov D, Ridgely MS, Huang C, et al. Project JOINTS: what factors affect bundle adoption in a voluntary quality improvement campaign? BMJ Qual Saf. 2015;24(1):38–47.CrossRefPubMed Khodyakov D, Ridgely MS, Huang C, et al. Project JOINTS: what factors affect bundle adoption in a voluntary quality improvement campaign? BMJ Qual Saf. 2015;24(1):38–47.CrossRefPubMed
14.
go back to reference Resar R, Pronovost P, Haraden C, et al. Using a bundle approach to improve ventilator care processes and reduce ventilator-associated pneumonia. Jt Comm J Qual Patient Saf. 2005;31(5):243–8.CrossRefPubMed Resar R, Pronovost P, Haraden C, et al. Using a bundle approach to improve ventilator care processes and reduce ventilator-associated pneumonia. Jt Comm J Qual Patient Saf. 2005;31(5):243–8.CrossRefPubMed
15.
go back to reference Bode LG, Kluytmans JA, Wertheim HF, et al. Preventing surgical-site infections in nasal carriers of Staphylococcus aureus. N Engl J Med. 2010;362(1):9–17.CrossRefPubMed Bode LG, Kluytmans JA, Wertheim HF, et al. Preventing surgical-site infections in nasal carriers of Staphylococcus aureus. N Engl J Med. 2010;362(1):9–17.CrossRefPubMed
16.
go back to reference Kim DH, Spencer M, Davidson SM, et al. Institutional prescreening for detection and eradication of methicillin-resistant Staphylococcus aureus in patients undergoing elective orthopaedic surgery. J Bone Joint Surg. 2010;92(9):1820–6.CrossRefPubMed Kim DH, Spencer M, Davidson SM, et al. Institutional prescreening for detection and eradication of methicillin-resistant Staphylococcus aureus in patients undergoing elective orthopaedic surgery. J Bone Joint Surg. 2010;92(9):1820–6.CrossRefPubMed
17.
go back to reference Paulson DS. Efficacy evaluation of a 4% chlorhexidine gluconate as a full-body shower wash. Am J Infect Control. 1993;21(4):205–9.CrossRefPubMed Paulson DS. Efficacy evaluation of a 4% chlorhexidine gluconate as a full-body shower wash. Am J Infect Control. 1993;21(4):205–9.CrossRefPubMed
18.
go back to reference Byrne D, Napier A, Phillips G, et al. Effects of whole body disinfection on skin flora in patients undergoing elective surgery. J Hosp Infect. 1991;17(3):217–22.CrossRefPubMed Byrne D, Napier A, Phillips G, et al. Effects of whole body disinfection on skin flora in patients undergoing elective surgery. J Hosp Infect. 1991;17(3):217–22.CrossRefPubMed
19.
go back to reference Kaiser A, Kernodle D, Barg N, et al. Influence of preoperative showers on staphylococcal skin colonization: a comparative trial of antiseptic skin cleansers. Ann Thorac Surg. 1988;78(1):35–8.CrossRef Kaiser A, Kernodle D, Barg N, et al. Influence of preoperative showers on staphylococcal skin colonization: a comparative trial of antiseptic skin cleansers. Ann Thorac Surg. 1988;78(1):35–8.CrossRef
20.
go back to reference Darouiche RO, Wall Jr MJ, Itani KM, et al. Chlorhexidine–alcohol versus povidone–iodine for surgical-site antisepsis. N Engl J Med. 2010;362(1):18–26.CrossRefPubMed Darouiche RO, Wall Jr MJ, Itani KM, et al. Chlorhexidine–alcohol versus povidone–iodine for surgical-site antisepsis. N Engl J Med. 2010;362(1):18–26.CrossRefPubMed
21.
go back to reference Swenson BR, Hedrick TL, Metzger R, et al. Effects of preoperative skin preparation on postoperative wound infection rates: a prospective study of 3 skin preparation protocols. Infect Control Hosp Epidemiol. 2009;30(10):964–71.CrossRefPubMedPubMedCentral Swenson BR, Hedrick TL, Metzger R, et al. Effects of preoperative skin preparation on postoperative wound infection rates: a prospective study of 3 skin preparation protocols. Infect Control Hosp Epidemiol. 2009;30(10):964–71.CrossRefPubMedPubMedCentral
22.
go back to reference Langley G, Nolan T, Nolan K, et al. The improvement guide: a practical guide to enhancing organizational performance. New York: Jossey-Bass; 1996. Langley G, Nolan T, Nolan K, et al. The improvement guide: a practical guide to enhancing organizational performance. New York: Jossey-Bass; 1996.
23.
go back to reference Institute for Healthcare Improvement. How-to guide: prevent surgical site infections. Cambridge: Institute for Healthcare Improvement; 2012. Institute for Healthcare Improvement. How-to guide: prevent surgical site infections. Cambridge: Institute for Healthcare Improvement; 2012.
24.
go back to reference Singer S, Meterko M, Baker L, et al. Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey. Health Serv Res. 2007;42(5):1999–2021.CrossRefPubMedPubMedCentral Singer S, Meterko M, Baker L, et al. Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey. Health Serv Res. 2007;42(5):1999–2021.CrossRefPubMedPubMedCentral
25.
go back to reference Neugebauer R, van der Laan M. Why prefer double robust estimators in causal inference? J Stat Plan Inference. 2005;129(1–2):405–26.CrossRef Neugebauer R, van der Laan M. Why prefer double robust estimators in causal inference? J Stat Plan Inference. 2005;129(1–2):405–26.CrossRef
27.
go back to reference McCaffrey DF, Griffin BA, Almirall D, et al. A tutorial on propensity score estimation for multiple treatments using generalized boosted models. Stat Med. 2013;32(19):3388–414.CrossRefPubMedPubMedCentral McCaffrey DF, Griffin BA, Almirall D, et al. A tutorial on propensity score estimation for multiple treatments using generalized boosted models. Stat Med. 2013;32(19):3388–414.CrossRefPubMedPubMedCentral
28.
go back to reference Bradley EH, Herrin J, Wang Y, et al. Strategies for reducing the door-to-balloon time in acute myocardial infarction. N Engl J Med. 2006;355(22):2308–20.CrossRefPubMed Bradley EH, Herrin J, Wang Y, et al. Strategies for reducing the door-to-balloon time in acute myocardial infarction. N Engl J Med. 2006;355(22):2308–20.CrossRefPubMed
29.
go back to reference Dixon-Woods M, Bosk CL, Aveling EL, et al. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205.CrossRefPubMedPubMedCentral Dixon-Woods M, Bosk CL, Aveling EL, et al. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205.CrossRefPubMedPubMedCentral
30.
go back to reference Bradley EH, Nallamothu BK, Herrin J, et al. National efforts to improve door-to-balloon time results from the Door-to-Balloon Alliance. J Am Coll Cardiol. 2009;54(25):2423–9.CrossRefPubMed Bradley EH, Nallamothu BK, Herrin J, et al. National efforts to improve door-to-balloon time results from the Door-to-Balloon Alliance. J Am Coll Cardiol. 2009;54(25):2423–9.CrossRefPubMed
31.
go back to reference Power M, Tyrrell PJ, Rudd AG, et al. Did a quality improvement collaborative make stroke care better? A cluster randomized trial. Implement Sci. 2014;9(1):40.CrossRefPubMedPubMedCentral Power M, Tyrrell PJ, Rudd AG, et al. Did a quality improvement collaborative make stroke care better? A cluster randomized trial. Implement Sci. 2014;9(1):40.CrossRefPubMedPubMedCentral
33.
go back to reference Soumerai SB, McLaughlin TJ, Gurwitz JH, et al. Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial [see comments]. JAMA. 1998;279(17):1358–63.CrossRefPubMed Soumerai SB, McLaughlin TJ, Gurwitz JH, et al. Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial [see comments]. JAMA. 1998;279(17):1358–63.CrossRefPubMed
34.
go back to reference Schweizer ML, Chiang HY, Septimus E, et al. Association of a bundled intervention with surgical site infections among patients undergoing cardiac, hip, or knee surgery. JAMA. 2015;313(21):2162–71.CrossRefPubMed Schweizer ML, Chiang HY, Septimus E, et al. Association of a bundled intervention with surgical site infections among patients undergoing cardiac, hip, or knee surgery. JAMA. 2015;313(21):2162–71.CrossRefPubMed
Metadata
Title
Does a quality improvement campaign accelerate take-up of new evidence? A ten-state cluster-randomized controlled trial of the IHI’s Project JOINTS
Authors
Eric C. Schneider
Melony E. Sorbero
Ann Haas
M. Susan Ridgely
Dmitry Khodyakov
Claude M. Setodji
Gareth Parry
Susan S. Huang
Deborah S. Yokoe
Don Goldmann
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-017-0579-7

Other articles of this Issue 1/2017

Implementation Science 1/2017 Go to the issue