Skip to main content
Top
Published in: Implementation Science 1/2019

Open Access 01-12-2019 | Osteoarthrosis | Research

In-depth comparison of two quality improvement collaboratives from different healthcare areas based on registry data—possible factors contributing to sustained improvement in outcomes beyond the project time

Authors: Beatrix Algurén, Annika Nordin, Boel Andersson-Gäre, Anette Peterson

Published in: Implementation Science | Issue 1/2019

Login to get access

Abstract

Background

Quality improvement collaboratives (QICs) are widely used to improve healthcare, but there are few studies of long-term sustained improved outcomes, and inconsistent evidence about what factors contribute to success. The aim of the study was to open the black box of QICs and compare characteristics and activities in detail of two differing QICs in relation to their changed outcomes from baseline and the following 3 years.

Methods

Final reports of two QICs—one on heart failure care with five teams, and one on osteoarthritis care with seven teams, including detailed descriptions of improvement projects from each QIC’s team, were analysed and coded by 18 QIC characteristics and four team characteristics. Goal variables from each team routinely collected within the Swedish Heart Failure Registry (SwedeHF) and the Better Management of Patients with OsteoArthritis Registry (BOA) at year 2013 (baseline), 2014, 2015 and 2016 were analysed with univariate statistics.

Results

The two QICs differed greatly in design. The SwedeHF-QIC involved eight experts and ran for 12 months, whereas the BOA-QIC engaged three experts and ran for 6 months. There were about twice as many activities in the SwedeHF-QIC as in the BOA-QIC and they ranged from standardisation of team coordination to better information and structured follow-ups. The outcome results were heterogeneous within teams and across teams and QICs. Both QICs were highly appreciated by the participants and contributed to their learning, e.g. of improvement methods; however, several teams had already reached goal values when the QICs were launched in 2013.

Conclusions

Even though many QI activities were carried out, it was difficult to see sustained improvements on outcomes. Outcomes as specific measurable aspects of care in need of improvement should be chosen carefully. Activities focusing on adherence to standard care programmes and on increased follow-up of patients seemed to lead to more long-lasting improvements. Although earlier studies showed that data follow-up and measurement skills as well as well-functioning data warehouses contribute to sustained improvements, the present registries’ functionality and QICs at this time did not support those aspects sufficiently. Further studies on QICs and their impact on improvement beyond the project time should investigate the effect of those elements in particular.
Literature
2.
go back to reference Ayers LR, Beyea SC, Godfrey MM, Harper DC, Nelson EC, Batalden PB. Quality improvement learning collaboratives. Qual Manag Health Care. 2005;14(4):234–47.CrossRef Ayers LR, Beyea SC, Godfrey MM, Harper DC, Nelson EC, Batalden PB. Quality improvement learning collaboratives. Qual Manag Health Care. 2005;14(4):234–47.CrossRef
3.
go back to reference Kilo CM, Kabcenell A, Berwick DM. Beyond survival: toward continuous improvement in medical care. New Horiz. 1998;6(1):3–11.PubMed Kilo CM, Kabcenell A, Berwick DM. Beyond survival: toward continuous improvement in medical care. New Horiz. 1998;6(1):3–11.PubMed
4.
go back to reference Mittman BS. Creating the evidence base for quality improvement collaboratives. Ann Intern Med. 2004;140(11):897–901.CrossRef Mittman BS. Creating the evidence base for quality improvement collaboratives. Ann Intern Med. 2004;140(11):897–901.CrossRef
5.
go back to reference Ovretveit J, Bate P, Cleary P, Cretin S, Gustafson D, McInnes K, et al. Quality collaboratives: lessons from research. Qual Saf Health Care. 2002;11(4):345–51.CrossRef Ovretveit J, Bate P, Cleary P, Cretin S, Gustafson D, McInnes K, et al. Quality collaboratives: lessons from research. Qual Saf Health Care. 2002;11(4):345–51.CrossRef
6.
go back to reference Gustafson DH, Quanbeck AR, Robinson JM, Ford JH III, Pulvermacher A, French MT, et al. Which elements of improvement collaboratives are most effective? A cluster-randomized trial. Addiction (Abingdon, England). 2013;108(6):1145–57.CrossRef Gustafson DH, Quanbeck AR, Robinson JM, Ford JH III, Pulvermacher A, French MT, et al. Which elements of improvement collaboratives are most effective? A cluster-randomized trial. Addiction (Abingdon, England). 2013;108(6):1145–57.CrossRef
7.
go back to reference Hulscher MEJL, Schouten LMT, Grol RPTM, Buchan H. Determinants of success of quality improvement collaboratives: what does the literature show? BMJ Qual Saf. 2013;22(1):19–31.CrossRef Hulscher MEJL, Schouten LMT, Grol RPTM, Buchan H. Determinants of success of quality improvement collaboratives: what does the literature show? BMJ Qual Saf. 2013;22(1):19–31.CrossRef
8.
go back to reference Nadeem E, Olin SS, Hill LC, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91(2):354–94.CrossRef Nadeem E, Olin SS, Hill LC, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91(2):354–94.CrossRef
9.
go back to reference Schouten LMT, Grol RPTM, Hulscher MEJL. Factors influencing success in quality-improvement collaboratives: development and psychometric testing of an instrument. Implement Sci. 2010;5:84.CrossRef Schouten LMT, Grol RPTM, Hulscher MEJL. Factors influencing success in quality-improvement collaboratives: development and psychometric testing of an instrument. Implement Sci. 2010;5:84.CrossRef
10.
go back to reference Wells S, Tamir O, Gray J, Naidoo D, Bekhit M, Goldmann D. Are quality improvement collaboratives effective? A systematic review. BMJ Qual Saf. 2018;27(3):226–40.CrossRef Wells S, Tamir O, Gray J, Naidoo D, Bekhit M, Goldmann D. Are quality improvement collaboratives effective? A systematic review. BMJ Qual Saf. 2018;27(3):226–40.CrossRef
11.
go back to reference Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40.CrossRef Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40.CrossRef
12.
go back to reference Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139.CrossRef Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139.CrossRef
13.
go back to reference Adami HO, Hernan MA. Learning how to improve healthcare delivery: the Swedish quality registers. J Intern Med. 2015;277(1):87–9.CrossRef Adami HO, Hernan MA. Learning how to improve healthcare delivery: the Swedish quality registers. J Intern Med. 2015;277(1):87–9.CrossRef
14.
go back to reference Emilsson L, Lindahl B, Koster M, Lambe M, Ludvigsson JF. Review of 103 Swedish healthcare quality registries. J Intern Med. 2015;277(1):94–136.CrossRef Emilsson L, Lindahl B, Koster M, Lambe M, Ludvigsson JF. Review of 103 Swedish healthcare quality registries. J Intern Med. 2015;277(1):94–136.CrossRef
15.
go back to reference Levay C. Policies to foster quality improvement registries: lessons from the Swedish case. J Intern Med. 2016;279(2):160–72.CrossRef Levay C. Policies to foster quality improvement registries: lessons from the Swedish case. J Intern Med. 2016;279(2):160–72.CrossRef
16.
go back to reference Religa D, Fereshtehnejad S-M, Cermakova P, Edlund A-K, Garcia-Ptacek S, Granqvist N, et al. SveDem, the Swedish Dementia Registry—a tool for improving the quality of diagnostics, treatment and care of dementia patients in clinical practice. PloS One. 2015;10(2):e0116538.CrossRef Religa D, Fereshtehnejad S-M, Cermakova P, Edlund A-K, Garcia-Ptacek S, Granqvist N, et al. SveDem, the Swedish Dementia Registry—a tool for improving the quality of diagnostics, treatment and care of dementia patients in clinical practice. PloS One. 2015;10(2):e0116538.CrossRef
17.
go back to reference Sjogren V, Grzymala-Lubanski B, Renlund H, Friberg L, Lip GYH, Svensson PJ, et al. Safety and efficacy of well managed warfarin a report from the Swedish quality register Auricula. Thromb Haemost. 2015;113(6):1370–7.CrossRef Sjogren V, Grzymala-Lubanski B, Renlund H, Friberg L, Lip GYH, Svensson PJ, et al. Safety and efficacy of well managed warfarin a report from the Swedish quality register Auricula. Thromb Haemost. 2015;113(6):1370–7.CrossRef
18.
go back to reference Peterson A, Carlhed R, Lindahl B, Lindstrom G, Aberg C, Andersson-Gare B, et al. Improving guideline adherence through intensive quality improvement and the use of a National Quality Register in Sweden for acute myocardial infarction. Qual Manag Health Care. 2007;16(1):25–37.CrossRef Peterson A, Carlhed R, Lindahl B, Lindstrom G, Aberg C, Andersson-Gare B, et al. Improving guideline adherence through intensive quality improvement and the use of a National Quality Register in Sweden for acute myocardial infarction. Qual Manag Health Care. 2007;16(1):25–37.CrossRef
19.
go back to reference Peterson A, Gudbjornsdottir S, Lofgren U-B, Schioler L, Bojestig M, Thor J, et al. Collaboratively improving diabetes care in Sweden using a national quality register: successes and challenges—a case study. Qual Manag Health Care. 2015;24(4):212–21.CrossRef Peterson A, Gudbjornsdottir S, Lofgren U-B, Schioler L, Bojestig M, Thor J, et al. Collaboratively improving diabetes care in Sweden using a national quality register: successes and challenges—a case study. Qual Manag Health Care. 2015;24(4):212–21.CrossRef
20.
go back to reference Peterson A, Hanberger L, Akesson K, Bojestig M, Gare BA, Samuelsson U. Improved results in paediatric diabetes care using a quality registry in an improvement collaborative: a case study in Sweden. PloS One. 2014;9(5):e97875.CrossRef Peterson A, Hanberger L, Akesson K, Bojestig M, Gare BA, Samuelsson U. Improved results in paediatric diabetes care using a quality registry in an improvement collaborative: a case study in Sweden. PloS One. 2014;9(5):e97875.CrossRef
21.
22.
go back to reference Rosén M. Översyn av de nationella kvalitetsregistren. Guldgruvan i hälso- och sjukvården. Förslag till gemensam satsning 2011–2015 (Review of the National Quality Registries. The Gold Mine in Health Care. Proposal for a Common Investment 2011–2015). Stockholm: Swedish Association of Local Authorities and Regions (SALAR); 2010. Rosén M. Översyn av de nationella kvalitetsregistren. Guldgruvan i hälso- och sjukvården. Förslag till gemensam satsning 2011–2015 (Review of the National Quality Registries. The Gold Mine in Health Care. Proposal for a Common Investment 2011–2015). Stockholm: Swedish Association of Local Authorities and Regions (SALAR); 2010.
23.
go back to reference SALAR. Överenskommelse mellan Sveriges Kommuner och Landsting (SKL) och staten - om utveckling och finansieringen av Nationella Kvalitetsregister för vård och omsorg under åren 2012–2016. Stockholm: SALAR (Swedish Association of Local Authorities and Regions); 2011. SALAR. Överenskommelse mellan Sveriges Kommuner och Landsting (SKL) och staten - om utveckling och finansieringen av Nationella Kvalitetsregister för vård och omsorg under åren 2012–2016. Stockholm: SALAR (Swedish Association of Local Authorities and Regions); 2011.
24.
go back to reference Yin RK. Case study research. Design and methods. 4th ed. Thousand Oaks: SAGE Publications, Inc.; 2009. Yin RK. Case study research. Design and methods. 4th ed. Thousand Oaks: SAGE Publications, Inc.; 2009.
25.
go back to reference Eisenhardt KM, Graebner ME. Theory building from cases: opportunities and challenges. Acad Manag J. 2007;50(1):25–32.CrossRef Eisenhardt KM, Graebner ME. Theory building from cases: opportunities and challenges. Acad Manag J. 2007;50(1):25–32.CrossRef
26.
go back to reference Donabedian A. Evaluating the quality of medical care (reprinted from the Milbank Memorial Fund Quarterly, vol 44, pg 166-203, 1966). Milbank Q. 2005;83(4):691–729.CrossRef Donabedian A. Evaluating the quality of medical care (reprinted from the Milbank Memorial Fund Quarterly, vol 44, pg 166-203, 1966). Milbank Q. 2005;83(4):691–729.CrossRef
27.
go back to reference Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implication for conducting a qualitative descriptive study. Nurs Health Sci. 2013;15:398–405.CrossRef Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implication for conducting a qualitative descriptive study. Nurs Health Sci. 2013;15:398–405.CrossRef
28.
go back to reference Kammerlind P, Henriks G, O’Connor A, Sterner M, Henriksson C, Koefer C. Färre hjärtsviktspatienter i sjukvården. (UCR) Uppsala Clinical Research Center: RCSO/Qulturum; 2014. Kammerlind P, Henriks G, O’Connor A, Sterner M, Henriksson C, Koefer C. Färre hjärtsviktspatienter i sjukvården. (UCR) Uppsala Clinical Research Center: RCSO/Qulturum; 2014.
29.
go back to reference Thorstensson C. Rapport från BOA-registrets förbättringsprojekt under tiden oktober 2013 till april 2014. Göteborg: Registercentrum Västra Götaland; 2014. Thorstensson C. Rapport från BOA-registrets förbättringsprojekt under tiden oktober 2013 till april 2014. Göteborg: Registercentrum Västra Götaland; 2014.
30.
go back to reference Carlhed R, Bellman C, Bojestig M, Bojo L, Peterson A, Lindahl B, et al. Quality improvement in coronary care: analysis of sustainability and impact on adjacent clinical measures after a Swedish controlled, multicenter quality improvement collaborative. J Am Heart Assoc. 2012;1(4):e000737.CrossRef Carlhed R, Bellman C, Bojestig M, Bojo L, Peterson A, Lindahl B, et al. Quality improvement in coronary care: analysis of sustainability and impact on adjacent clinical measures after a Swedish controlled, multicenter quality improvement collaborative. J Am Heart Assoc. 2012;1(4):e000737.CrossRef
31.
go back to reference O'Connor GT, Plume SK, Olmstead EM, Morton JR, Maloney CT, Nugent WC, et al. A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The northern New England cardiovascular disease study group. JAMA. 1996;275(11):841–6.CrossRef O'Connor GT, Plume SK, Olmstead EM, Morton JR, Maloney CT, Nugent WC, et al. A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The northern New England cardiovascular disease study group. JAMA. 1996;275(11):841–6.CrossRef
33.
go back to reference Luckenbaugh AN, Auffenberg GB. Leveraging the clinical collaborative model to drive value improvement. Curr Opin Urol. 2018;28(4):348–53.PubMed Luckenbaugh AN, Auffenberg GB. Leveraging the clinical collaborative model to drive value improvement. Curr Opin Urol. 2018;28(4):348–53.PubMed
34.
go back to reference Alagoz E, Chih MY, Hitchcock M, Brown R, Quanbeck A. The use of external change agents to promote quality improvement and organizational change in healthcare organizations: a systematic review. BMC Health Serv Res. 2018;18(1):42.CrossRef Alagoz E, Chih MY, Hitchcock M, Brown R, Quanbeck A. The use of external change agents to promote quality improvement and organizational change in healthcare organizations: a systematic review. BMC Health Serv Res. 2018;18(1):42.CrossRef
35.
go back to reference IHI. Institute of Healthcare Improvement. The breakthrough series: IHI’s collaborative model for achieving breakthrough improvement. Diabetes Spectr. 2004;17(2):97.CrossRef IHI. Institute of Healthcare Improvement. The breakthrough series: IHI’s collaborative model for achieving breakthrough improvement. Diabetes Spectr. 2004;17(2):97.CrossRef
36.
go back to reference Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6) Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6)
37.
go back to reference Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:14.CrossRef Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:14.CrossRef
38.
go back to reference Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10:21.CrossRef Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10:21.CrossRef
40.
go back to reference Bosch M, van der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract. 2007;13(2):161–8.CrossRef Bosch M, van der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract. 2007;13(2):161–8.CrossRef
41.
go back to reference Powell BJ, Proctor EK. Learning from implementation as usual in children’s mental health. Implement. Sci. 2016;11(Suppl 1):A56. Powell BJ, Proctor EK. Learning from implementation as usual in children’s mental health. Implement. Sci. 2016;11(Suppl 1):A56.
Metadata
Title
In-depth comparison of two quality improvement collaboratives from different healthcare areas based on registry data—possible factors contributing to sustained improvement in outcomes beyond the project time
Authors
Beatrix Algurén
Annika Nordin
Boel Andersson-Gäre
Anette Peterson
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2019
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-019-0926-y

Other articles of this Issue 1/2019

Implementation Science 1/2019 Go to the issue