Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2011

Open Access 01-12-2011 | Study protocol

Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care

Authors: Sabine N van der Veer, Maartje LG de Vos, Kitty J Jager, Peter HJ van der Voort, Niels Peek, Gert P Westert, Wilco C Graafmans, Nicolette F de Keizer

Published in: Implementation Science | Issue 1/2011

Login to get access

Abstract

Background

Feedback is potentially effective in improving the quality of care. However, merely sending reports is no guarantee that performance data are used as input for systematic quality improvement (QI). Therefore, we developed a multifaceted intervention tailored to prospectively analyzed barriers to using indicators: the Information Feedback on Quality Indicators (InFoQI) program. This program aims to promote the use of performance indicator data as input for local systematic QI. We will conduct a study to assess the impact of the InFoQI program on patient outcome and organizational process measures of care, and to gain insight into barriers and success factors that affected the program's impact. The study will be executed in the context of intensive care. This paper presents the study's protocol.

Methods/design

We will conduct a cluster randomized controlled trial with intensive care units (ICUs) in the Netherlands. We will include ICUs that submit indicator data to the Dutch National Intensive Care Evaluation (NICE) quality registry and that agree to allocate at least one intensivist and one ICU nurse for implementation of the intervention. Eligible ICUs (clusters) will be randomized to receive basic NICE registry feedback (control arm) or to participate in the InFoQI program (intervention arm). The InFoQI program consists of comprehensive feedback, establishing a local, multidisciplinary QI team, and educational outreach visits. The primary outcome measures will be length of ICU stay and the proportion of shifts with a bed occupancy rate above 80%. We will also conduct a process evaluation involving ICUs in the intervention arm to investigate their actual exposure to and experiences with the InFoQI program.

Discussion

The results of this study will inform those involved in providing ICU care on the feasibility of a tailored multifaceted performance feedback intervention and its ability to accelerate systematic and local quality improvement. Although our study will be conducted within the domain of intensive care, we believe our conclusions will be generalizable to other settings that have a quality registry including an indicator set available.

Trial registration

Current Controlled Trials ISRCTN50542146
Appendix
Available only for authorised users
Literature
1.
Langley GJ, Moen RD, Nolan KM, Nolan TW, Norman CL, Provost LP: The improvement guide: a practical approach to enhancing organizational performance. 2009, San Francisco: Jossey-Bass Publishers
2.
Berwick DM: Developing and testing changes in delivery of care. Annals of Internal Medicine. 1998, 128: 651-6.CrossRefPubMed
3.
Lilford R, Mohammed MA, Spiegelhalter D, Thomson R: Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. The Lancet. 2004, 363: 1147-1154. 10.1016/S0140-6736(04)15901-1.CrossRef
4.
5.
Kastrup M, von D V, Seeling M, Ahlborn R, Tamarkin A, Conroy P, Boemke W, Wernecke KD, Spies C: Key performance indicators in intensive care medicine. A retrospective matched cohort study. J Int Med Res. 2009, 37: 1267-1284.CrossRefPubMed
6.
Berenholtz SM, Pronovost PJ, Ngo K, Barie PS, Hitt J, Kuti JL, Septimus E, Lawler N, Schilling L, Dorman T: Developing quality measures for sepsis care in the ICU. Jt Comm J Qual Patient Saf. 2007, 33: 559-568.PubMed
7.
De Vos M, Graafmans W, Keesman E, Westert G, Van der Voort P: Quality measurement at intensive care units: which indicators should we use?. Journal of Critical Care. 2007, 22: 267-74. 10.1016/j.jcrc.2007.01.002.CrossRefPubMed
8.
Martin MC, Cabre L, Ruiz J, Blanch L, Blanco J, Castillo F, Galdos P, Roca J, Saura RM: [Indicators of quality in the critical patient]. Med Intensiva. 2008, 32: 23-32. 10.1016/S0210-5691(08)70899-4.CrossRefPubMed
9.
Pronovost PJ, Berenholtz SM, Ngo K, McDowell M, Holzmueller C, Haraden C, Resar R, Rainey T, Nolan T, Dorman T: Developing and pilot testing quality indicators in the intensive care unit. J Crit Care. 2003, 18: 145-155. 10.1016/j.jcrc.2003.08.003.CrossRefPubMed
10.
Harrison DA, Brady AR, Rowan K: Case mix, outcome and length of stay for admissions to adult general critical care units in England, Wales and Northern Ireland: the Intensive Care National Audit & Research Centre Case Mix Programme Database. Critical Care. 2004, 8: R99-111. 10.1186/cc2834.CrossRefPubMedPubMedCentral
11.
Stow PJ, Hart GK, Higlett T, George C, Herkes R, McWilliam D, Bellomo R: Development and implementation of a high-quality clinical database: the Australian and New Zealand Intensive Care Society Adult Patient Database. Journal of Critical Care. 2006, 21: 133-41. 10.1016/j.jcrc.2005.11.010.CrossRefPubMed
12.
Cook SF, Visscher WA, Hobbs CL, Williams RL, the Project IMPACT Clinical Implementation Committee: Project IMPACT: Results from a pilot validity study of a new observational database. Critical Care Medicine. 2002, 30: 2765-70. 10.1097/00003246-200212000-00024.CrossRefPubMed
13.
Bakshi-Raiez F, Peek N, Bosman RJ, De Jonge E, De Keizer NF: The impact of different prognostic models and their customization on institutional comparison of intensive care units. Critical Care Medicine. 2007, 35: 2553-60. 10.1097/01.CCM.0000288123.29559.5A.CrossRef
14.
Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, CD000259-2
15.
Van der Veer SN, De Keizer NF, Ravelli ACJ, Tenkink S, Jager KJ: Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. International Journal for Medical Informatics. 2010, 79: 305-23. 10.1016/j.ijmedinf.2010.01.011.CrossRef
16.
De Vos M, Graafmans W, Kooistra M, Meijboom B, Van der Voort P, Westert G: Using quality indicators to improve hospital care: a review of the literature. International Journal for Quality in Health Care. 2009, 21: 119-29. 10.1093/intqhc/mzn059.CrossRefPubMed
17.
De Vos M, Van der Veer SN, Graafmans W, De Keizer NF, Jager KJ, Westert G, Van der Voort P: Implementing quality indicators in ICUs: exploring barriers to and facilitators of behaviour change. Implementation Science. 2010, 5: 52-10.1186/1748-5908-5-52.CrossRefPubMedPubMedCentral
18.
Bosch M, van der Weijden T, Wensing M, Grol R: Tailoring quality improvement interventions to identified barriers: a multiple case analysis. Journal of Evaluation in Clinical Practice. 2007, 13: 161-168. 10.1111/j.1365-2753.2006.00660.x.CrossRefPubMed
19.
Van Bokhoven MA, Kok G, Van der Weijden T: Designing a quality improvement intervention: a systematic approach. Quality & Safety in Health Care. 2003, 12: 215-20. 10.1136/qhc.12.3.215.CrossRef
20.
Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG, Donner A: Methods in health service research. Evaluation of health interventions at area and organisation level. BMJ. 1999, 319: 376-379. 10.1136/bmj.319.7206.376.CrossRefPubMedPubMedCentral
21.
Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ: A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009, 62: 464-475. 10.1016/j.jclinepi.2008.12.011.CrossRefPubMed
22.
Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
23.
24.
Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008, 337: a2390-10.1136/bmj.a2390.CrossRefPubMedPubMedCentral
25.
Wunsch H, Angus DC, Harrison DA, Collange O, Fowler R, Hoste EA, de Keizer NF, Kersten A, Linde-Zwirble WT, Sandiumenge A: Variation in critical care services across North America and Western Europe. Crit Care Med. 2008, 36: 2787-2789. 10.1097/CCM.0b013e318186aec8.CrossRefPubMed
26.
Zimmerman JE, Kramer AA, McNair DS, Malila FM: Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients. Crit Care Med. 2006, 34: 1297-1310. 10.1097/01.CCM.0000215112.84523.F0.CrossRefPubMed
27.
Benneyan JC, Lloyd RC, Plsek PE: Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care. 2003, 12: 458-64. 10.1136/qhc.12.6.458.CrossRefPubMedPubMedCentral
28.
Guyatt G, Jaeschke R, Heddle N, Cook D, Shannon H, Walter S: Basic statistics for clinicians: 1. Hypothesis testing. CMAJ. 1995, 152: 27-32.PubMedPubMedCentral
29.
Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW: Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001, 285: 2871-2879. 10.1001/jama.285.22.2871.CrossRefPubMed
30.
Netherlands Society for Anesthesiology: Richtlijn Organisatie en werkwijze op intensive care-afdelingen voor volwassenen in Nederland [Guideline Organisation and working processes of ICUs for adults in the Netherlands]. 2006, Alphen aan den Rijn, the Netherlands: Van Zuiden Communications B.V
31.
Arts D, de KN, Scheffer GJ, de JE: Quality of data collected for severity of illness scores in the Dutch National Intensive Care Evaluation (NICE) registry. Intensive Care Med. 2002, 28: 656-659. 10.1007/s00134-002-1272-z.CrossRefPubMed
32.
Arts DG, De Keizer NF, Scheffer GJ: Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc. 2002, 9: 600-611. 10.1197/jamia.M1087.CrossRefPubMedPubMedCentral
33.
Putter H, Fiocco M, Geskus RB: Tutorial in biostatistics: competing risks and multi-state models. Stat Med. 2007, 26: 2389-2430. 10.1002/sim.2712.CrossRefPubMed
34.
Logan BR, Zhang MJ, Klein JP: Marginal models for clustered time-to-event data with competing risks using pseudovalues. Biometrics. 2011, 67: 1-7. 10.1111/j.1541-0420.2010.01416.x.CrossRefPubMedPubMedCentral
35.
Donner A, Klar N: Design and analysis of cluster randomization trials in health research. 2000, London: Arnold
36.
Zeger SL, Liang KY: Longitudinal data analysis for discrete and continuous outcomes. Biometrics. 1986, 42: 121-130. 10.2307/2531248.CrossRefPubMed
37.
38.
Arts DG, Bosman RJ, de JE, Joore JC, de Keizer NF: Training in data definitions improves quality of intensive care data. Crit Care. 2003, 7: 179-184. 10.1186/cc1886.CrossRefPubMedPubMedCentral
39.
Needham DM, Sinopoli DJ, Dinglas VD, Berenholtz SM, Korupolu R, Watson SR, Lubomski L, Goeschel C, Pronovost PJ: Improving data quality control in quality improvement projects. Int J Qual Health Care. 2009, 21: 145-150. 10.1093/intqhc/mzp005.CrossRefPubMedPubMedCentral
40.
Montgomery AA, Peters TJ, Little P: Design, analysis and presentation of factorial randomised controlled trials. BMC Med Res Methodol. 2003, 3: 26-10.1186/1471-2288-3-26.CrossRefPubMedPubMedCentral
41.
Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ. 1998, 317: 465-468. 10.1136/bmj.317.7156.465.CrossRefPubMedPubMedCentral
42.
Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R: What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005, 5: 50-10.1186/1472-6963-5-50.CrossRefPubMedPubMedCentral
43.
Eagle KA, Mulley AG, Skates SJ, Reder VA, Nicholson BW, Sexton JO, Barnett GO, Thibault GE: Length of stay in the intensive care unit. Effects of practice guidelines and feedback. JAMA. 1990, 264: 992-997. 10.1001/jama.264.8.992.CrossRefPubMed
44.
Clemmer TP, Spuhler VJ, Oniki TA, Horn SD: Results of a collaborative quality improvement program on outcomes and costs in a tertiary critical care unit. Crit Care Med. 1999, 27: 1768-1774. 10.1097/00003246-199909000-00011.CrossRefPubMed
45.
Berenholtz S, Needham DM, Lubomski LH, Goeschel CA, Pronovost P: Improving the quality of quality improvement projects. The Joint Commission Journal on Quality and Patient Safety. 2010, 36: 468-73.PubMed
46.
Auerbach AD, Landefeld CS, Shojania KG: The tension between needing to improve care and knowing how to do it. N Engl J Med. 2007, 357: 608-613. 10.1056/NEJMsb070738.CrossRefPubMed
47.
Shojania KG, Grimshaw JM: Evidence-based quality improvement: the state of the science. Health Aff (Millwood ). 2005, 24: 138-150. 10.1377/hlthaff.24.1.138.CrossRef
48.
Chuang JH, Hripcsak G, Heitjan DF: Design and analysis of controlled trials in naturally clustered environments: implications for medical informatics. J Am Med Inform Assoc. 2002, 9: 230-238. 10.1197/jamia.M0997.CrossRefPubMedPubMedCentral
49.
Eccles M, Grimshaw JM, Campbell M, Ramsay C: Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care. 2003, 12: 47-52. 10.1136/qhc.12.1.47.CrossRefPubMedPubMedCentral
50.
Scales DC, Dainty K, Hales B, Pinto R, Fowler RA, Adhikari NK, Zwarenstein M: A multifaceted intervention for quality improvement in a network of intensive care units: a cluster randomized trial. JAMA. 2011, 305: 363-372. 10.1001/jama.2010.2000.CrossRefPubMed
51.
Horbar JD, Carpenter JH, Buzas J, Soll RF, Suresh G, Bracken MB, Leviton LC, Plsek PE, Sinclair JC: Collaborative quality improvement to promote evidence based surfactant for preterm infants: a cluster randomised trial. BMJ. 2004, 329: 1004-10.1136/bmj.329.7473.1004.CrossRefPubMedPubMedCentral
52.
Hendryx MS, Fieselmann JF, Bock J, Wakefield DS, Helms CM, Bentler SE: Outreach education to improve quality of rural ICU care. Am J Respir Crit Care Med. 1998, 158: 418-23.CrossRefPubMed
Metadata
Title
Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care
Authors
Sabine N van der Veer
Maartje LG de Vos
Kitty J Jager
Peter HJ van der Voort
Niels Peek
Gert P Westert
Wilco C Graafmans
Nicolette F de Keizer
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2011
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-6-119

Other articles of this Issue 1/2011

Implementation Science 1/2011 Go to the issue

Study protocol

Developing and evaluating interventions to reduce inappropriate prescribing by general practitioners of antibiotics for upper respiratory tract infections: A randomised controlled trial to compare paper-based and web-based modelling experiments

Research

The updating of clinical practice guidelines: insights from an international survey

Research

From PALSA PLUS to PALM PLUS: adapting and developing a South African guideline and training intervention to better integrate HIV/AIDS care with primary care in rural health centers in Malawi

Research

Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC)

Study protocol

Tailored implementation for chronic diseases (TICD): A project protocol

Study protocol

Helping hands: A cluster randomised trial to evaluate the effectiveness of two different strategies for promoting hand hygiene in hospital nurses