Skip to main content
Top
Published in: Annals of Intensive Care 1/2017

Open Access 01-12-2017 | Research

Impact of random safety analyses on structure, process and outcome indicators: multicentre study

Authors: María Bodí, Iban Oliva, Maria Cruz Martín, Maria Carmen Gilavert, Carlos Muñoz, Montserrat Olona, Gonzalo Sirgo

Published in: Annals of Intensive Care | Issue 1/2017

Login to get access

Abstract

Background

To assess the impact of a real-time random safety tool on structure, process and outcome indicators.

Methods

Prospective study conducted over a period of 12 months in two adult patient intensive care units. Safety rounds were conducted three days a week ascertaining 37 safety measures (grouped into 10 blocks). In each round, 50% of the patients and 50% of the measures were randomized. The impact of this safety tool was analysed on indicators of structure (safety culture, healthcare protocols), process (improvement proportion related to tool application, IPR) and outcome (mortality, average stay, rate of catheter-related bacteraemias and rate of ventilator-associated pneumonia, VAP).

Results

A total of 1214 patient-days were analysed. Structure indicators: the use of the safety tool was associated with an increase in the safety climate and the creation/modification of healthcare protocols (sedation/analgesia and weaning). Process indicators: Twelve of the 37 measures had an IPR > 10%; six showed a progressive decrease in the IPR over the study period. Nursing workloads and patient severity on the day of analysis were independently associated with a higher IPR in half of the blocks of variables. Outcome indicators: A significant decrease in the rate of VAP was observed.

Conclusions

The real-time random safety tool improved the care process and adherence to clinical practice guidelines and was associated with an improvement in structure, process and outcome indicators.
Appendix
Available only for authorised users
Literature
1.
go back to reference Curtis JR, Cook DJ, Wall RJ, Angus DC, Bion J, Kacmarek R, et al. Intensive care unit quality improvement: a how-to guide for the interdisciplinary team. Crit Care Med. 2006;34:211–8.CrossRefPubMed Curtis JR, Cook DJ, Wall RJ, Angus DC, Bion J, Kacmarek R, et al. Intensive care unit quality improvement: a how-to guide for the interdisciplinary team. Crit Care Med. 2006;34:211–8.CrossRefPubMed
2.
go back to reference Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.CrossRefPubMed Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.CrossRefPubMed
3.
go back to reference Ilan R, Fowler RA, Geerts R, Pinto R, Sibbald WJ, Martin CM. Knowledge translation in critical care: factors associated with prescription of commonly recommended best practices for critically ill patients. Crit Care Med. 2007;35:1696–702.CrossRefPubMed Ilan R, Fowler RA, Geerts R, Pinto R, Sibbald WJ, Martin CM. Knowledge translation in critical care: factors associated with prescription of commonly recommended best practices for critically ill patients. Crit Care Med. 2007;35:1696–702.CrossRefPubMed
4.
go back to reference Ursprung R, Gray JE, Edwards WH, Horbar JD, Nickerson J, Plsek P, et al. Real time patient safety audits: improving safety every day. Qual Saf Health Care. 2005;14:284–9.CrossRefPubMedPubMedCentral Ursprung R, Gray JE, Edwards WH, Horbar JD, Nickerson J, Plsek P, et al. Real time patient safety audits: improving safety every day. Qual Saf Health Care. 2005;14:284–9.CrossRefPubMedPubMedCentral
5.
go back to reference Byrnes MC, Schuerer DJE, Schallom ME, Sona CS, Mazuski JE, Taylor BE, et al. Implementation of a mandatory checklist of protocols and objectives improves compliance with a wide range of evidence-based intensive care unit practices. Crit Care Med. 2009;37:2775–81.CrossRefPubMed Byrnes MC, Schuerer DJE, Schallom ME, Sona CS, Mazuski JE, Taylor BE, et al. Implementation of a mandatory checklist of protocols and objectives improves compliance with a wide range of evidence-based intensive care unit practices. Crit Care Med. 2009;37:2775–81.CrossRefPubMed
6.
go back to reference Bergs J, Lambrechts F, Simons P, Vlayen A, Marneffe W, Hellings J, et al. Barriers and facilitators related to the implementation of surgical safety checklist: a systematic review of the qualitative evidence. BMJ Qual Saf. 2015;24:776–86.CrossRefPubMed Bergs J, Lambrechts F, Simons P, Vlayen A, Marneffe W, Hellings J, et al. Barriers and facilitators related to the implementation of surgical safety checklist: a systematic review of the qualitative evidence. BMJ Qual Saf. 2015;24:776–86.CrossRefPubMed
7.
go back to reference Lee L, Girish S, Van den Berg E, Leaf A. Random safety audits in the neonatal unit. Arch Dis Child Fetal Neonatal Ed. 2009;94:F116–9.CrossRefPubMed Lee L, Girish S, Van den Berg E, Leaf A. Random safety audits in the neonatal unit. Arch Dis Child Fetal Neonatal Ed. 2009;94:F116–9.CrossRefPubMed
8.
go back to reference Leape LL, Berwick DM, Bates DW. What practices will most improve safety? Evidence-based medicine meets patient safety. JAMA. 2002;288:501–7.PubMed Leape LL, Berwick DM, Bates DW. What practices will most improve safety? Evidence-based medicine meets patient safety. JAMA. 2002;288:501–7.PubMed
9.
go back to reference Weiss CH, Moazed F, McEvoy CA, Singer BD, Szleifer I, Amaral LA, et al. Prompting physician to address a daily checklist and process of care and clinical outcomes. Am J Respir Crit Care Med. 2011;184:680–6.CrossRefPubMedPubMedCentral Weiss CH, Moazed F, McEvoy CA, Singer BD, Szleifer I, Amaral LA, et al. Prompting physician to address a daily checklist and process of care and clinical outcomes. Am J Respir Crit Care Med. 2011;184:680–6.CrossRefPubMedPubMedCentral
10.
go back to reference Sirgo Rodríguez G, Olona Cabases M, Martin Delgado MC, Esteban Reboll F, Pobo Peris A, Bodí Saera M, ART-SACC Study Experts. Audits in real time for safety in critical care: definition and pilot study. Med Intensiva. 2014;38:472–86.CrossRef Sirgo Rodríguez G, Olona Cabases M, Martin Delgado MC, Esteban Reboll F, Pobo Peris A, Bodí Saera M, ART-SACC Study Experts. Audits in real time for safety in critical care: definition and pilot study. Med Intensiva. 2014;38:472–86.CrossRef
11.
go back to reference Bodí M, Olona M, Martín MC, Alceaga R, Rodríguez JC, Corral E, et al. Feasibility and utility of the use of real time random safety audits in adult ICU patients: a multicentre study. Intensive Care Med. 2015;41:1089–98.CrossRefPubMed Bodí M, Olona M, Martín MC, Alceaga R, Rodríguez JC, Corral E, et al. Feasibility and utility of the use of real time random safety audits in adult ICU patients: a multicentre study. Intensive Care Med. 2015;41:1089–98.CrossRefPubMed
12.
go back to reference Gutiérrez-Cía I, de Cos PM, Juan AY, Obón-Azuara B, Alonso-Ovies Á, Martin-Delgado MC, et al. Perception of safety culture in Spanish intensive care units. Med Clin. 2010;135(Suppl 1):37–44.CrossRef Gutiérrez-Cía I, de Cos PM, Juan AY, Obón-Azuara B, Alonso-Ovies Á, Martin-Delgado MC, et al. Perception of safety culture in Spanish intensive care units. Med Clin. 2010;135(Suppl 1):37–44.CrossRef
13.
go back to reference Mermel LA, Allon M, Bouza E, Graven DE, Flynn P, O’Grady NP, et al. Clinical practice guidelines for the diagnosis and management of intravascular catheter-related infections: 2009 update by the Infectious Diseases Society of America. Clin Infect Dis. 2009;49:1–45.CrossRefPubMedPubMedCentral Mermel LA, Allon M, Bouza E, Graven DE, Flynn P, O’Grady NP, et al. Clinical practice guidelines for the diagnosis and management of intravascular catheter-related infections: 2009 update by the Infectious Diseases Society of America. Clin Infect Dis. 2009;49:1–45.CrossRefPubMedPubMedCentral
14.
go back to reference Klompas M, Kleinman K, Khan Y, Evans RS, Lloyd JF, Stevenson K, et al. Rapid and reproducible surveillance for ventilator-associated pneumonia. Clin Infect Dis. 2012;54:370–7.CrossRefPubMed Klompas M, Kleinman K, Khan Y, Evans RS, Lloyd JF, Stevenson K, et al. Rapid and reproducible surveillance for ventilator-associated pneumonia. Clin Infect Dis. 2012;54:370–7.CrossRefPubMed
15.
go back to reference Thomassen Ø, Storesund A, Søfteland E, Brattebø G. The effects of safety checklist in medicine: a systematic review. Acta Anaesthesiol Scand. 2014;58:5–18.CrossRefPubMed Thomassen Ø, Storesund A, Søfteland E, Brattebø G. The effects of safety checklist in medicine: a systematic review. Acta Anaesthesiol Scand. 2014;58:5–18.CrossRefPubMed
16.
go back to reference Mittman BS. Creating the evidence base for quality improvement collaborative. Ann Intern Med. 2004;140:897–901.CrossRefPubMed Mittman BS. Creating the evidence base for quality improvement collaborative. Ann Intern Med. 2004;140:897–901.CrossRefPubMed
17.
go back to reference Singer S, Gaba D, Geppert J, Sinaiko AD, Howard SK, Park KC. The culture of safety: results of an organization-wide survey in 15 California hospitals. Qual Saf Health Care. 2003;12:112–8.CrossRefPubMedPubMedCentral Singer S, Gaba D, Geppert J, Sinaiko AD, Howard SK, Park KC. The culture of safety: results of an organization-wide survey in 15 California hospitals. Qual Saf Health Care. 2003;12:112–8.CrossRefPubMedPubMedCentral
18.
go back to reference Huang DT, Clermont G, Kong L, Weissfeld LA, Sexton JB, Rowan KM, et al. Intensive care unit safety culture and outcomes: a US multicenter study. Int J Qual Health Care. 2010;22:151–61.CrossRefPubMedPubMedCentral Huang DT, Clermont G, Kong L, Weissfeld LA, Sexton JB, Rowan KM, et al. Intensive care unit safety culture and outcomes: a US multicenter study. Int J Qual Health Care. 2010;22:151–61.CrossRefPubMedPubMedCentral
19.
go back to reference Valentin A, Schiffinger M, Steyrer J, Huber C, Strunk G. Safety climate reduces medication and dislodgement errors in routine intensive care practice. Intensive Care Med. 2013;39:391–8.CrossRefPubMed Valentin A, Schiffinger M, Steyrer J, Huber C, Strunk G. Safety climate reduces medication and dislodgement errors in routine intensive care practice. Intensive Care Med. 2013;39:391–8.CrossRefPubMed
20.
go back to reference Böhmer AB, Kindermann P, Schwanke U, Bellendir M, Tinschmann T, Schmidt C, et al. Long-term effects of a perioperative safety checklist from the viewpoint of personnel. Acta Anaesthesiol Scand. 2013;57:150–7.CrossRefPubMed Böhmer AB, Kindermann P, Schwanke U, Bellendir M, Tinschmann T, Schmidt C, et al. Long-term effects of a perioperative safety checklist from the viewpoint of personnel. Acta Anaesthesiol Scand. 2013;57:150–7.CrossRefPubMed
21.
go back to reference Randmaa M, Mårtensson G, Leo Swenne CL, Engström M. SBAR improves communication and safety climate and decreases incident reports due to communication errors in an anaesthetic clinic: a prospective intervention study. BMJ Open. 2014;4:e004268.CrossRefPubMedPubMedCentral Randmaa M, Mårtensson G, Leo Swenne CL, Engström M. SBAR improves communication and safety climate and decreases incident reports due to communication errors in an anaesthetic clinic: a prospective intervention study. BMJ Open. 2014;4:e004268.CrossRefPubMedPubMedCentral
22.
go back to reference Roffey P, Thangathurai D. Increased use of protocols in ICU settings. Intensive Care Med. 2011;37:1402.CrossRefPubMed Roffey P, Thangathurai D. Increased use of protocols in ICU settings. Intensive Care Med. 2011;37:1402.CrossRefPubMed
23.
go back to reference Needham DM. Patient safety, quality of care, and knowledge translation in the intensive care unit. Respir Care. 2010;55:922–8.PubMed Needham DM. Patient safety, quality of care, and knowledge translation in the intensive care unit. Respir Care. 2010;55:922–8.PubMed
24.
go back to reference Sneyers B, Laterre PF, Perreault MM, Wouters D, Spinewine A. Current practices and barriers impairing physicians’ and nurses’adherence to analgo-sedation recommendations in the intensive care unit–a national survey. Crit Care. 2014;18:655.CrossRefPubMedPubMedCentral Sneyers B, Laterre PF, Perreault MM, Wouters D, Spinewine A. Current practices and barriers impairing physicians’ and nurses’adherence to analgo-sedation recommendations in the intensive care unit–a national survey. Crit Care. 2014;18:655.CrossRefPubMedPubMedCentral
25.
go back to reference Rose L, Dainty KN, Jordan J, et al. Weaning from mechanical ventilation: a scoping review of qualitative studies. Am J Crit Care. 2014;23:e54–70.CrossRefPubMed Rose L, Dainty KN, Jordan J, et al. Weaning from mechanical ventilation: a scoping review of qualitative studies. Am J Crit Care. 2014;23:e54–70.CrossRefPubMed
26.
go back to reference Soares M, Bozza FA, Angus DC, Japiassú AM, Viana WN, Costa R, et al. Organizational characteristics, outcomes, and resource use in 78 Brazilian intensive care units: the ORCHESTRA study. Intensive Care Med. 2015;41:2149–60.CrossRefPubMed Soares M, Bozza FA, Angus DC, Japiassú AM, Viana WN, Costa R, et al. Organizational characteristics, outcomes, and resource use in 78 Brazilian intensive care units: the ORCHESTRA study. Intensive Care Med. 2015;41:2149–60.CrossRefPubMed
27.
go back to reference Isherwood P. Response to: Protocols: help for improvement but beware of regression to the mean and mediocrity. Intensive Care Med. 2016;42:631.CrossRefPubMed Isherwood P. Response to: Protocols: help for improvement but beware of regression to the mean and mediocrity. Intensive Care Med. 2016;42:631.CrossRefPubMed
28.
go back to reference Girbes AR, Robert R, Marik PE. Protocols: help for improvement but beware of regression to the mean and mediocrity. Intensive Care Med. 2015;41:2218–20.CrossRefPubMed Girbes AR, Robert R, Marik PE. Protocols: help for improvement but beware of regression to the mean and mediocrity. Intensive Care Med. 2015;41:2218–20.CrossRefPubMed
29.
go back to reference Sevransky JE, Checkley W, Herrera P, Pickering BW, Barr J, Brown SM, United States Critical Illness and Injury Trials Group-Critical Illness Outcomes Study Investigators, et al. Protocols and hospital mortality in critically ill patients: the USA Critical Illness and Injury Trials Group Critical Illness Outcomes Study. Crit Care Med. 2015;43:2076–84.CrossRefPubMed Sevransky JE, Checkley W, Herrera P, Pickering BW, Barr J, Brown SM, United States Critical Illness and Injury Trials Group-Critical Illness Outcomes Study Investigators, et al. Protocols and hospital mortality in critically ill patients: the USA Critical Illness and Injury Trials Group Critical Illness Outcomes Study. Crit Care Med. 2015;43:2076–84.CrossRefPubMed
30.
go back to reference Pronovost P, Holzmueller CG, Needham DM, Sexton JB, Miller M, Berenholtz S, et al. How will we know patients are safer? An organization-wide approach to measuring and improving safety. Crit Care Med. 2006;34:1988–95.CrossRefPubMed Pronovost P, Holzmueller CG, Needham DM, Sexton JB, Miller M, Berenholtz S, et al. How will we know patients are safer? An organization-wide approach to measuring and improving safety. Crit Care Med. 2006;34:1988–95.CrossRefPubMed
31.
go back to reference Kiyoshi-Teo H, Cabana MD, Froelicher ES, Blegen MA. Adherence to institution-specific ventilator-associated pneumonia prevention guidelines. Am J Crit Care. 2014;23:201–14.CrossRefPubMed Kiyoshi-Teo H, Cabana MD, Froelicher ES, Blegen MA. Adherence to institution-specific ventilator-associated pneumonia prevention guidelines. Am J Crit Care. 2014;23:201–14.CrossRefPubMed
32.
go back to reference Wadhwani V, Shillingford A, Penford G, Thomson MA. Random safety audits for improving standards in the neonatal unit. Arch Dis Child Fetal Neonatal Ed. 2011;96:Fa49.CrossRef Wadhwani V, Shillingford A, Penford G, Thomson MA. Random safety audits for improving standards in the neonatal unit. Arch Dis Child Fetal Neonatal Ed. 2011;96:Fa49.CrossRef
33.
go back to reference Teixeira PGR, Inaba K, DuBose J, Melo N, Bass M, Belzberg H, et al. Measurable outcomes of quality improvement using a daily quality rounds checklist: two-year prospective analysis of sustainability in a surgical intensive care unit. J Trauma Acute Care Surg. 2013;75:717–21.CrossRefPubMed Teixeira PGR, Inaba K, DuBose J, Melo N, Bass M, Belzberg H, et al. Measurable outcomes of quality improvement using a daily quality rounds checklist: two-year prospective analysis of sustainability in a surgical intensive care unit. J Trauma Acute Care Surg. 2013;75:717–21.CrossRefPubMed
34.
go back to reference Resar R, Pronovost P, Haraden C, Simmonds T, Rainey T, Nolan T. Using a bundle approach to improve ventilator care processes and reduce ventilator-associated pneumonia. Jt Comm J Qual Patient Saf. 2005;31:243–8.CrossRefPubMed Resar R, Pronovost P, Haraden C, Simmonds T, Rainey T, Nolan T. Using a bundle approach to improve ventilator care processes and reduce ventilator-associated pneumonia. Jt Comm J Qual Patient Saf. 2005;31:243–8.CrossRefPubMed
35.
go back to reference Dubose J, Teixeira PG, Inaba K, Lam L, Talving P, Putty B, et al. Measurable outcomes of quality improvement using a daily quality rounds checklist: one-year analysis in a trauma intensive care unit with sustained ventilator-associated pneumonia reduction. J Trauma. 2010;69:855–60.CrossRefPubMed Dubose J, Teixeira PG, Inaba K, Lam L, Talving P, Putty B, et al. Measurable outcomes of quality improvement using a daily quality rounds checklist: one-year analysis in a trauma intensive care unit with sustained ventilator-associated pneumonia reduction. J Trauma. 2010;69:855–60.CrossRefPubMed
36.
go back to reference Hsu YJ, Marsteller JA. Influence of the comprehensive Unit-based Safety Program in ICUs: evidence from the keystone ICU Project. Am J Med Qual. 2016;31:349–57.CrossRefPubMed Hsu YJ, Marsteller JA. Influence of the comprehensive Unit-based Safety Program in ICUs: evidence from the keystone ICU Project. Am J Med Qual. 2016;31:349–57.CrossRefPubMed
37.
go back to reference Writing Group for the CHECKLIST-ICU Investigators and the Brazilian Research in Intensive Care Network (BRICNet), Cavalcanti AB, Bozza FA, Machado FR, Salluh JI, Campagnucci VP, Vendramim P, et al. Effect of a quality improvement intervention with daily round checklists, goal setting, and clinician prompting on mortality of critically ill patients: a randomized clinical trial. JAMA. 2016;315:1480–90.CrossRef Writing Group for the CHECKLIST-ICU Investigators and the Brazilian Research in Intensive Care Network (BRICNet), Cavalcanti AB, Bozza FA, Machado FR, Salluh JI, Campagnucci VP, Vendramim P, et al. Effect of a quality improvement intervention with daily round checklists, goal setting, and clinician prompting on mortality of critically ill patients: a randomized clinical trial. JAMA. 2016;315:1480–90.CrossRef
38.
go back to reference Weled BJ, Adzhigirey LA, Hodgman TM, Brilli RJ, Spevetz A, Kline AM, et al. Critical care delivery: the importance of process of care and ICU structure to improved outcomes: an update from the American College of critical care medicine task force on models of critical care. Crit Care Med. 2015;43:1520–5.CrossRefPubMed Weled BJ, Adzhigirey LA, Hodgman TM, Brilli RJ, Spevetz A, Kline AM, et al. Critical care delivery: the importance of process of care and ICU structure to improved outcomes: an update from the American College of critical care medicine task force on models of critical care. Crit Care Med. 2015;43:1520–5.CrossRefPubMed
Metadata
Title
Impact of random safety analyses on structure, process and outcome indicators: multicentre study
Authors
María Bodí
Iban Oliva
Maria Cruz Martín
Maria Carmen Gilavert
Carlos Muñoz
Montserrat Olona
Gonzalo Sirgo
Publication date
01-12-2017
Publisher
Springer Paris
Published in
Annals of Intensive Care / Issue 1/2017
Electronic ISSN: 2110-5820
DOI
https://doi.org/10.1186/s13613-017-0245-x

Other articles of this Issue 1/2017

Annals of Intensive Care 1/2017 Go to the issue