Skip to main content
Top
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Research

A multifaceted feedback strategy alone does not improve the adherence to organizational guideline-based standards: a cluster randomized trial in intensive care

Authors: Maartje L. G. de Vos, Sabine N. van der Veer, Bram Wouterse, Wilco C. Graafmans, Niels Peek, Nicolette F. de Keizer, Kitty J. Jager, Gert P. Westert, Peter H. J. van der Voort

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Organizational data such as bed occupancy rate and nurse-to-patient ratio are related to clinical outcomes and to the efficient use of intensive care unit (ICU) resources. Standards for these performance indicators are provided in guidelines. We studied the effects of a multifaceted feedback strategy to improve the adherence to these standards.

Methods

In a cluster randomized controlled study design the intervention ICUs received extensive monthly feedback reports, they received outreach visits and initiated a quality improvement team. The control ICUs received limited quarterly feedback reports only. We collected primary data prospectively within the setting of a Dutch national ICU registry over a 14-month study period. The target indicators were bed occupancy rate (aiming at 80 % or below) and nurse-to-patient ratio (aiming at 0.5 or higher). Data were collected per 8-h nursing shift. Logistic regression analysis was performed. For both study end points, the odds ratios (OR) for improvements at follow-up versus at baseline were calculated separately for control and intervention ICUs.

Results

We analyzed data on 67,237 nursing shifts. The bed occupancy rate did not improve in the intervention group compared to baseline (adjusted OR 0.88; 95 % confidence interval (CI), 0.62–1.27) or compared to control group (OR 0.67; 95 % CI 0.39–1.15). The nurse-to-patient ratio did not improve (OR 0.72; 95 % CI 0.41–1.26 compared to baseline and OR 0.65; 95 % CI 0.35–1.19 compared to control group).

Conclusions

A multifaceted feedback intervention did not improve the adherence to guideline-based standards on the organizational issues bed occupancy rate and nurse-to-patient ratio in the ICU. The reasons may be a limited confidence in data quality, the lack of practical tools for improvement, and the relatively short follow-up.

Trial registration

Literature
1.
go back to reference Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA. 2002;288:1987–93.CrossRefPubMed Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA. 2002;288:1987–93.CrossRefPubMed
2.
go back to reference Amaravadi RK, Dimick JB, Pronovost PJ, Lipsett PA. ICU nurse-to-patient ratio is associated with complications and resource use after esophagectomy. Intensive Care Med. 2000;26:1857–62.CrossRefPubMed Amaravadi RK, Dimick JB, Pronovost PJ, Lipsett PA. ICU nurse-to-patient ratio is associated with complications and resource use after esophagectomy. Intensive Care Med. 2000;26:1857–62.CrossRefPubMed
3.
go back to reference Cho S-H, Hwang JH, Kim J. Nurse staffing and patient mortality in intensive care units. Nurs Res. 2008;57:322–30.CrossRefPubMed Cho S-H, Hwang JH, Kim J. Nurse staffing and patient mortality in intensive care units. Nurs Res. 2008;57:322–30.CrossRefPubMed
4.
go back to reference Garfield M, Jeffrey R, Ridley S. An assessment of the staffing level required for a high-dependency unit. Anaesthesia. 2000;55:137–43.CrossRefPubMed Garfield M, Jeffrey R, Ridley S. An assessment of the staffing level required for a high-dependency unit. Anaesthesia. 2000;55:137–43.CrossRefPubMed
5.
go back to reference Dimick JB, Swoboda SM, Pronovost PJ, Lipsett PA. Effect of nurse-to-patient ratio in the intensive care unit on pulmonary complications and resource use after hepatectomy. Am J Crit Care. 2001;10:376–82.PubMed Dimick JB, Swoboda SM, Pronovost PJ, Lipsett PA. Effect of nurse-to-patient ratio in the intensive care unit on pulmonary complications and resource use after hepatectomy. Am J Crit Care. 2001;10:376–82.PubMed
6.
go back to reference Iapichino G, Pezzi A, Borotto E, Mistraletti G, Meroni M, Corbella D. Performance determinants and flexible ICU organisation. Minerva Anestesiol. 2005;71:273–80.PubMed Iapichino G, Pezzi A, Borotto E, Mistraletti G, Meroni M, Corbella D. Performance determinants and flexible ICU organisation. Minerva Anestesiol. 2005;71:273–80.PubMed
7.
go back to reference Metcalfe MA, Sloggett A, McPherson K. Mortality among appropriately referred patients refused admission to intensive-care units. Lancet. 1997;350:7–11.CrossRefPubMed Metcalfe MA, Sloggett A, McPherson K. Mortality among appropriately referred patients refused admission to intensive-care units. Lancet. 1997;350:7–11.CrossRefPubMed
8.
go back to reference Howie AJ, Ridley SA. Bed occupancy and incidence of methicillin-resistant Staphylococcus aureus infection in an intensive care unit. Anaesthesia. 2008;63:1070–3.CrossRefPubMed Howie AJ, Ridley SA. Bed occupancy and incidence of methicillin-resistant Staphylococcus aureus infection in an intensive care unit. Anaesthesia. 2008;63:1070–3.CrossRefPubMed
9.
go back to reference Zilberberg MD, Shorr AF. Prolonged acute mechanical ventilation and hospital bed utilization in 2020 in the United States: implications for budgets, plant and personnel planning. BMC Health Serv Res. 2008;8:242.CrossRefPubMedPubMedCentral Zilberberg MD, Shorr AF. Prolonged acute mechanical ventilation and hospital bed utilization in 2020 in the United States: implications for budgets, plant and personnel planning. BMC Health Serv Res. 2008;8:242.CrossRefPubMedPubMedCentral
10.
go back to reference Dutch Society for Anesthesiology. Richtlijn organisatie en werkwijze op intensive care- afdelingen voor volwassenen in Nederland [Guideline organisation and working processes of ICUs for adults in The Netherlands]. Van Zuiden Communications: Alphen aan de Rijn; 2006. Dutch Society for Anesthesiology. Richtlijn organisatie en werkwijze op intensive care- afdelingen voor volwassenen in Nederland [Guideline organisation and working processes of ICUs for adults in The Netherlands]. Van Zuiden Communications: Alphen aan de Rijn; 2006.
11.
go back to reference Valentin A, Ferdinande P. ESICM working group on quality improvement. Recommendations on basic requirements for intensive care units: structural and organizational aspects. Intensive Care Med. 2011;37:1575–87.CrossRefPubMed Valentin A, Ferdinande P. ESICM working group on quality improvement. Recommendations on basic requirements for intensive care units: structural and organizational aspects. Intensive Care Med. 2011;37:1575–87.CrossRefPubMed
12.
go back to reference Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PC, et al. Why don’t physicians follow clinical practice guidelines? JAMA. 1999;282:1458–65.CrossRefPubMed Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PC, et al. Why don’t physicians follow clinical practice guidelines? JAMA. 1999;282:1458–65.CrossRefPubMed
13.
go back to reference Vers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6, CD000259. Vers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6, CD000259.
14.
go back to reference van der Veer SN, de Keizer NF, Ravelli ACJ, Tenkink S, Jager KJ. Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int J Med Inform. 2010;79:305–23.CrossRefPubMed van der Veer SN, de Keizer NF, Ravelli ACJ, Tenkink S, Jager KJ. Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int J Med Inform. 2010;79:305–23.CrossRefPubMed
15.
go back to reference Scales DC, Dainty K, Hales B, Pinto R, Fowler RA, Adhikari NKJ, et al. A multifaceted intervention for quality improvement in a network of intensive care units: a cluster randomized trial. JAMA. 2011;305:363–72.CrossRefPubMed Scales DC, Dainty K, Hales B, Pinto R, Fowler RA, Adhikari NKJ, et al. A multifaceted intervention for quality improvement in a network of intensive care units: a cluster randomized trial. JAMA. 2011;305:363–72.CrossRefPubMed
16.
go back to reference Garrouste-Orgeas M, Soufir L, Tabah A, Schwebel C, Vesin A, Adrie C, et al. A multifaceted program for improving quality of care in intensive care units: IATROREF study. Crit Care Med. 2012;40:468–76.CrossRefPubMed Garrouste-Orgeas M, Soufir L, Tabah A, Schwebel C, Vesin A, Adrie C, et al. A multifaceted program for improving quality of care in intensive care units: IATROREF study. Crit Care Med. 2012;40:468–76.CrossRefPubMed
17.
go back to reference Doig GS, Simpson F, Finfer S, Delaney A, Davies AR, Mitchell I, et al. Effect of evidence-based feeding guidelines on mortality of critically ill adults: a cluster randomized controlled trial. JAMA. 2008;300:2731–41.CrossRefPubMed Doig GS, Simpson F, Finfer S, Delaney A, Davies AR, Mitchell I, et al. Effect of evidence-based feeding guidelines on mortality of critically ill adults: a cluster randomized controlled trial. JAMA. 2008;300:2731–41.CrossRefPubMed
18.
go back to reference Carlson RW, Weiland DE, Srivathsan K. Does a full-time, 24-hour intensivist improve care and efficiency? Crit Care Clin. 1996;12:525–51.CrossRefPubMed Carlson RW, Weiland DE, Srivathsan K. Does a full-time, 24-hour intensivist improve care and efficiency? Crit Care Clin. 1996;12:525–51.CrossRefPubMed
19.
go back to reference de Vos M, Graafmans W, Keesman E, Westert G, van der Voort PH. Quality measurement at intensive care units: which indicators should we use? J Crit Care. 2007;22:267–74.CrossRefPubMed de Vos M, Graafmans W, Keesman E, Westert G, van der Voort PH. Quality measurement at intensive care units: which indicators should we use? J Crit Care. 2007;22:267–74.CrossRefPubMed
20.
go back to reference van der Voort PHJ, van der Veer SN, de Vos MLG. The use of indicators to improve the quality of intensive care: theoretical aspects and experiences from the Dutch intensive care registry. Acta Anaesthesiol Scand. 2012;56:1084–91.CrossRefPubMed van der Voort PHJ, van der Veer SN, de Vos MLG. The use of indicators to improve the quality of intensive care: theoretical aspects and experiences from the Dutch intensive care registry. Acta Anaesthesiol Scand. 2012;56:1084–91.CrossRefPubMed
21.
go back to reference Arts D, de Keizer N, Scheffer G-J, de Jonge E. Quality of data collected for severity of illness scores in the Dutch National Intensive Care Evaluation (NICE) registry. Intensive Care Med. 2002;28:656–9.CrossRefPubMed Arts D, de Keizer N, Scheffer G-J, de Jonge E. Quality of data collected for severity of illness scores in the Dutch National Intensive Care Evaluation (NICE) registry. Intensive Care Med. 2002;28:656–9.CrossRefPubMed
22.
go back to reference De Vos ML, Van der Veer SN, Graafmans WC, de Keizer NF, Jager KJ, Westert GP, et al. Implementing quality indicators in ICUs: exploring barriers to and facilitators of behaviour change. Implement Sci. 2010;5:52.CrossRefPubMedPubMedCentral De Vos ML, Van der Veer SN, Graafmans WC, de Keizer NF, Jager KJ, Westert GP, et al. Implementing quality indicators in ICUs: exploring barriers to and facilitators of behaviour change. Implement Sci. 2010;5:52.CrossRefPubMedPubMedCentral
23.
go back to reference de Vos M, Graafmans W, Kooistra M, Meijboom B, Van Der Voort P, Westert G. Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care. 2009;21:119–29.CrossRefPubMed de Vos M, Graafmans W, Kooistra M, Meijboom B, Van Der Voort P, Westert G. Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care. 2009;21:119–29.CrossRefPubMed
24.
go back to reference van der Veer SN, de Vos ML, Jager KJ, van der Voort PH, Peek N, Westert GP, et al. Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care. Implement Sci. 2011;6:119.CrossRefPubMedPubMedCentral van der Veer SN, de Vos ML, Jager KJ, van der Voort PH, Peek N, Westert GP, et al. Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care. Implement Sci. 2011;6:119.CrossRefPubMedPubMedCentral
25.
go back to reference Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001;134:657–62.CrossRefPubMed Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001;134:657–62.CrossRefPubMed
26.
go back to reference Arts DGT, De Keizer NF, Scheffer G-J. Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc. 2002;9:600–11.CrossRefPubMedPubMedCentral Arts DGT, De Keizer NF, Scheffer G-J. Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc. 2002;9:600–11.CrossRefPubMedPubMedCentral
27.
go back to reference Madden JM, Graves AJ, Zhang F, Adams AS, Briesacher BA, Ross-Degnan D, et al. Cost-related medication nonadherence and spending on basic needs following implementation of Medicare Part D. JAMA. 2008;299:1922–8.CrossRefPubMedPubMedCentral Madden JM, Graves AJ, Zhang F, Adams AS, Briesacher BA, Ross-Degnan D, et al. Cost-related medication nonadherence and spending on basic needs following implementation of Medicare Part D. JAMA. 2008;299:1922–8.CrossRefPubMedPubMedCentral
28.
go back to reference Kiefe CI, Weissman NW, Allison JJ, Farmer R, Weaver M, Williams OD. Identifying achievable benchmarks of care: concepts and methodology. Int J Qual Health Care. 1998;10:443–7.CrossRefPubMed Kiefe CI, Weissman NW, Allison JJ, Farmer R, Weaver M, Williams OD. Identifying achievable benchmarks of care: concepts and methodology. Int J Qual Health Care. 1998;10:443–7.CrossRefPubMed
29.
go back to reference Bradley EH, Holmboe ES, Mattera JA, Roumanis SA, Radford MJ, Krumholz HM. Data feedback efforts in quality improvement: lessons learned from US hospitals. Qual Saf Health Care. 2004;13:26–31.CrossRefPubMedPubMedCentral Bradley EH, Holmboe ES, Mattera JA, Roumanis SA, Radford MJ, Krumholz HM. Data feedback efforts in quality improvement: lessons learned from US hospitals. Qual Saf Health Care. 2004;13:26–31.CrossRefPubMedPubMedCentral
30.
go back to reference De Vos MLG, van der Veer SN, Graafmans W, de Jager KJ, de Keizer NF, Westert G, et al. Process evaluation of a tailored multifaceted feedback program to improve the quality of intensive care by using quality indicators. BMJ Quality and Safety; 2013;22:233–41.CrossRef De Vos MLG, van der Veer SN, Graafmans W, de Jager KJ, de Keizer NF, Westert G, et al. Process evaluation of a tailored multifaceted feedback program to improve the quality of intensive care by using quality indicators. BMJ Quality and Safety; 2013;22:233–41.CrossRef
Metadata
Title
A multifaceted feedback strategy alone does not improve the adherence to organizational guideline-based standards: a cluster randomized trial in intensive care
Authors
Maartje L. G. de Vos
Sabine N. van der Veer
Bram Wouterse
Wilco C. Graafmans
Niels Peek
Nicolette F. de Keizer
Kitty J. Jager
Gert P. Westert
Peter H. J. van der Voort
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-015-0285-2

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue