Skip to main content
Top
Published in: Intensive Care Medicine 6/2015

01-06-2015 | Original

Feasibility and utility of the use of real time random safety audits in adult ICU patients: a multicentre study

Authors: M. Bodí, M. Olona, M. C. Martín, R. Alceaga, J. C. Rodríguez, E. Corral, J. M. Pérez Villares, G. Sirgo

Published in: Intensive Care Medicine | Issue 6/2015

Login to get access

Abstract

Purpose

The two aims of this study were first to analyse the feasibility and utility (to improve the care process) of implementing a new real time random safety tool and second to explore the efficacy of this tool in core hospitals (those participating in tool design) versus non-core hospitals.

Methods

This was a prospective study conducted over a period of 4 months in six adult intensive care units (two of which were core hospitals). Safety audits were conducted 3 days per week during the entire study period to determine the efficacy of the 37 safety measures (grouped into ten blocks). In each audit, 50 % of patients and 50 % of measures were randomized. Feasibility was calculated as the proportion of audits completed over those scheduled and time spent, and utility was defined as the changes in the care process resulting from tool application.

Results

A total of 1323 patient-days were analysed. In terms of feasibility, 87.6 % of the scheduled audits were completed. The average time spent per audit was 34.5 ± 29 min. Globally, changes in the care process occurred in 5.4 % of the measures analysed. In core hospitals, utility was significantly higher in 16 of the 37 measures, all of which were included in good clinical practice guidelines. Most of the clinical changes brought about by the tool occurred in the mechanical ventilation and haemodynamics blocks. Multivariate analyses demonstrated that changes in the care process in each block were associated with the core hospital variable, staffing ratios and severity of patient disease.

Conclusions

Real time safety audits improved the care process and adherence to the clinical practice guidelines and proved to be most useful in situations of high care load and in patients with more severe disease. The effect was greater in core hospitals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Merino P, Álvarez J, Martín MC, Alonso A, Gutiérrez I, SYREC study investigators (2012) Adverse events in Spanish intensive care units: the SYREC study. Adverse events in Spanish intensive care units: the SYREC study. Int J Qual Health Care 24:105–113PubMedCrossRef Merino P, Álvarez J, Martín MC, Alonso A, Gutiérrez I, SYREC study investigators (2012) Adverse events in Spanish intensive care units: the SYREC study. Adverse events in Spanish intensive care units: the SYREC study. Int J Qual Health Care 24:105–113PubMedCrossRef
2.
go back to reference Donchin Y, Gopher D, Olin M, Badihi Y, Biesky M, Sprung CL, Pizov R, Cotev S (2003) A look into the nature and causes of human errors in the intensive care unit 1995. Qual Saf Health Care 12:143–147PubMedCentralPubMedCrossRef Donchin Y, Gopher D, Olin M, Badihi Y, Biesky M, Sprung CL, Pizov R, Cotev S (2003) A look into the nature and causes of human errors in the intensive care unit 1995. Qual Saf Health Care 12:143–147PubMedCentralPubMedCrossRef
3.
go back to reference Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR (1999) Why don’t physicians follow clinical practice guidelines?A framework for improvement. JAMA 282:1458–1465PubMedCrossRef Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR (1999) Why don’t physicians follow clinical practice guidelines?A framework for improvement. JAMA 282:1458–1465PubMedCrossRef
4.
go back to reference Ilan R, Fowler RA, Geerts R, Pinto R, Sibbald WJ, Martin CM (2007) Knowledge translation in critical care: factors associated with prescription of commonly recommended best practices for critically ill patients. Crit Care Med 35:1696–1702PubMedCrossRef Ilan R, Fowler RA, Geerts R, Pinto R, Sibbald WJ, Martin CM (2007) Knowledge translation in critical care: factors associated with prescription of commonly recommended best practices for critically ill patients. Crit Care Med 35:1696–1702PubMedCrossRef
5.
go back to reference The McDonnell Norms Group (2006) Enhancing the use of clinical guidelines: a social norms perspective. J Am Coll Surg 202:826–836CrossRef The McDonnell Norms Group (2006) Enhancing the use of clinical guidelines: a social norms perspective. J Am Coll Surg 202:826–836CrossRef
6.
go back to reference Ursprung R, Gray JE, Edwards WH, Horbar JD, Nickerson J, Plsek P, Shiono PH, Suresh GK, Goldmann DA (2005) Real time patient safety audits: improving safety every day. Qual Saf Health Care 14:284–289PubMedCentralPubMedCrossRef Ursprung R, Gray JE, Edwards WH, Horbar JD, Nickerson J, Plsek P, Shiono PH, Suresh GK, Goldmann DA (2005) Real time patient safety audits: improving safety every day. Qual Saf Health Care 14:284–289PubMedCentralPubMedCrossRef
7.
go back to reference Byrnes MC, Schuerer DJE, Schallom ME, Sona CS, Mazuski JE, Taylor BE, McKenzie W, Thomas JM, Emerson JS, Nemeth JL, Bailey RA, Boyle WA, Buchman TG, Coopersmith CM (2009) Implementation of a mandatory checklist of protocols and objectives improves compliance with a wide range of evidence-based intensive care unit practices. Crit Care Med 37:2775–2781PubMedCrossRef Byrnes MC, Schuerer DJE, Schallom ME, Sona CS, Mazuski JE, Taylor BE, McKenzie W, Thomas JM, Emerson JS, Nemeth JL, Bailey RA, Boyle WA, Buchman TG, Coopersmith CM (2009) Implementation of a mandatory checklist of protocols and objectives improves compliance with a wide range of evidence-based intensive care unit practices. Crit Care Med 37:2775–2781PubMedCrossRef
8.
go back to reference Lee L, Girish S, van den Berg E, Leaf A (2009) Random safety audits in the neonatal unit. Arch Dis Child Fetal Neonatal Ed 94:F116–F119PubMedCrossRef Lee L, Girish S, van den Berg E, Leaf A (2009) Random safety audits in the neonatal unit. Arch Dis Child Fetal Neonatal Ed 94:F116–F119PubMedCrossRef
9.
go back to reference Centofanti JE, Duan EH, Hoad NC, Swinton ME, Perri D, Waugh L, Cocinero DJ (2014) Use of a daily goals checklist for morning ICU rounds: a mixed-methods study. Crit Care Med 42:1797–1803PubMedCrossRef Centofanti JE, Duan EH, Hoad NC, Swinton ME, Perri D, Waugh L, Cocinero DJ (2014) Use of a daily goals checklist for morning ICU rounds: a mixed-methods study. Crit Care Med 42:1797–1803PubMedCrossRef
11.
go back to reference Sirgo Rodríguez G, Olona Cabases M, Martin Delgado MC, Esteban Reboll F, Pobo Peris A, Bodí Saera M, ART-SACC study experts (2014) Audits in real time for safety in critical care: definition and pilot study. Med Intensiva 38:473–482PubMedCrossRef Sirgo Rodríguez G, Olona Cabases M, Martin Delgado MC, Esteban Reboll F, Pobo Peris A, Bodí Saera M, ART-SACC study experts (2014) Audits in real time for safety in critical care: definition and pilot study. Med Intensiva 38:473–482PubMedCrossRef
12.
go back to reference Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, Margolis P (2010) The influence of context on quality improvement success in the Elath care: a systematic review of the literature. Milbank Quat 88:500–559CrossRef Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, Margolis P (2010) The influence of context on quality improvement success in the Elath care: a systematic review of the literature. Milbank Quat 88:500–559CrossRef
13.
go back to reference Timsit JF, Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Azoulay E (2014) Year in review in Intensive Care Medicine 2013: III. Sepsis, infections, respiratory diseases, pediatrics. Intensive Care Med 40:471–483PubMedCrossRef Timsit JF, Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Azoulay E (2014) Year in review in Intensive Care Medicine 2013: III. Sepsis, infections, respiratory diseases, pediatrics. Intensive Care Med 40:471–483PubMedCrossRef
14.
go back to reference Azoulay E, Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Timsit JF (2014) Year in review in Intensive Care Medicine 2013: II. Sedation, invasive and noninvasive ventilation, airways, ARDS, ECMO, family satisfaction, end-of-life care, organ donation, informed consent, safety, hematological issues in critically ill patients. Intensive Care Med 40:305–319PubMedCrossRef Azoulay E, Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Timsit JF (2014) Year in review in Intensive Care Medicine 2013: II. Sedation, invasive and noninvasive ventilation, airways, ARDS, ECMO, family satisfaction, end-of-life care, organ donation, informed consent, safety, hematological issues in critically ill patients. Intensive Care Med 40:305–319PubMedCrossRef
15.
go back to reference Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Timsit JF, Azoulay E (2014) Year in review in Intensive Care Medicine 2013: I. Acute kidney injury, ultrasound, hemodynamics, cardiac arrest, transfusion, neurocritical care, and nutrition. Intensive Care Med 40:147–159PubMedCrossRef Citerio G, Bakker J, Bassetti M, Benoit D, Cecconi M, Curtis JR, Hernandez G, Herridge M, Jaber S, Joannidis M, Papazian L, Peters M, Singer P, Smith M, Soares M, Torres A, Vieillard-Baron A, Timsit JF, Azoulay E (2014) Year in review in Intensive Care Medicine 2013: I. Acute kidney injury, ultrasound, hemodynamics, cardiac arrest, transfusion, neurocritical care, and nutrition. Intensive Care Med 40:147–159PubMedCrossRef
16.
go back to reference Valentin A, Capuzzo M, Guidet B, Moreno RP, Dolanski L, Bauer P, Metnitz PGH (2006) Pateint safety in intensive care: results from the multinacional Sentinel Events Evaluation (SEE) study. Intensive Care Med 32:1591–1598PubMedCrossRef Valentin A, Capuzzo M, Guidet B, Moreno RP, Dolanski L, Bauer P, Metnitz PGH (2006) Pateint safety in intensive care: results from the multinacional Sentinel Events Evaluation (SEE) study. Intensive Care Med 32:1591–1598PubMedCrossRef
17.
go back to reference Garrouste-Orgeas M, Timsit JF, Vesin A, Schwebel C, Arnodo P, Lefrant JY, Souweine B, Tabah A, Charpentier J, Gontier O, Fieux F, Mourvillier B, Troché G, Reignier J, Dumay MF, Azoulay E, Reignier B, Carlet J, Soufr L (2010) Selected medical errors in the intensive care unit: results of the IATROREF study: parts I and II. Am J Respir Crit Care Med 181:134–142PubMedCrossRef Garrouste-Orgeas M, Timsit JF, Vesin A, Schwebel C, Arnodo P, Lefrant JY, Souweine B, Tabah A, Charpentier J, Gontier O, Fieux F, Mourvillier B, Troché G, Reignier J, Dumay MF, Azoulay E, Reignier B, Carlet J, Soufr L (2010) Selected medical errors in the intensive care unit: results of the IATROREF study: parts I and II. Am J Respir Crit Care Med 181:134–142PubMedCrossRef
18.
go back to reference Quenot JP, Plantefeve G, Baudel JL, Camilatto I, Bertholet E, Cailliod R, Reignier J, Rigaud JP (2010) Bedside adherence to clinical practice guidelines for enteral nutrition in critically ill patients receiving mechanical ventilation: a prospective, multi-centre, observational study. Crit Care 14:R37PubMedCentralPubMedCrossRef Quenot JP, Plantefeve G, Baudel JL, Camilatto I, Bertholet E, Cailliod R, Reignier J, Rigaud JP (2010) Bedside adherence to clinical practice guidelines for enteral nutrition in critically ill patients receiving mechanical ventilation: a prospective, multi-centre, observational study. Crit Care 14:R37PubMedCentralPubMedCrossRef
19.
go back to reference Aujoulat I, Jacquemin P, Rietzschel E, Scheen A, Tréfois P, Wens J, Darras E, Hermans MP (2014) Factors associated with clinical inertia: an integrative review. Adv Med Educ Pract 5:141–147PubMedCentralPubMedCrossRef Aujoulat I, Jacquemin P, Rietzschel E, Scheen A, Tréfois P, Wens J, Darras E, Hermans MP (2014) Factors associated with clinical inertia: an integrative review. Adv Med Educ Pract 5:141–147PubMedCentralPubMedCrossRef
20.
go back to reference Kash BA, Spaulding A, Johnson CE, Gamm L (2014) Success factors for strategic change initiatives: a qualitative study of healthcare administrator´perspectives. J Health Manag 59:65–81 Kash BA, Spaulding A, Johnson CE, Gamm L (2014) Success factors for strategic change initiatives: a qualitative study of healthcare administrator´perspectives. J Health Manag 59:65–81
21.
go back to reference Erasmus V, Daha TJ, Brug H, Richardus JH, Behrendt MD, Vos MC, van Beeck EF (2010) Systematic review of studies on compliance with hand hygiene guidelines in hospital care. Infect Control Hosp Epidemiol 31:283–294PubMedCrossRef Erasmus V, Daha TJ, Brug H, Richardus JH, Behrendt MD, Vos MC, van Beeck EF (2010) Systematic review of studies on compliance with hand hygiene guidelines in hospital care. Infect Control Hosp Epidemiol 31:283–294PubMedCrossRef
22.
go back to reference McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA (2003) The quality of health care delivered to adults in the United States. New Engl J Med 348:2635–2645PubMedCrossRef McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA (2003) The quality of health care delivered to adults in the United States. New Engl J Med 348:2635–2645PubMedCrossRef
23.
go back to reference McMullin J, Cook D, Griffith L, McDonald E, Clarke F, Guyatt G, Gibson J, Crowther M (2006) Minimizing errors of omission: behavioural re-enforcement of heparin to avert venous emboli: the behave study. Crit Care Med 34:694–699PubMedCrossRef McMullin J, Cook D, Griffith L, McDonald E, Clarke F, Guyatt G, Gibson J, Crowther M (2006) Minimizing errors of omission: behavioural re-enforcement of heparin to avert venous emboli: the behave study. Crit Care Med 34:694–699PubMedCrossRef
24.
go back to reference Gurses AP, Marsteller JA, Ozok A, Xiao Y, Owens S, Pronovost PJ (2010) Using an interdisciplinary approach to identify factors that affect clinicians´compliance with evidence-based guidelines. Crit Care Med 38:S82–S91CrossRef Gurses AP, Marsteller JA, Ozok A, Xiao Y, Owens S, Pronovost PJ (2010) Using an interdisciplinary approach to identify factors that affect clinicians´compliance with evidence-based guidelines. Crit Care Med 38:S82–S91CrossRef
25.
go back to reference Kiyoshi-Teo H, Cabana MD, Froelicher ES, Blegen MA (2014) Adherence to institution-specific ventilador-associated pneumonia prevention guidelines. Am J Crit Care 23:201–214PubMedCrossRef Kiyoshi-Teo H, Cabana MD, Froelicher ES, Blegen MA (2014) Adherence to institution-specific ventilador-associated pneumonia prevention guidelines. Am J Crit Care 23:201–214PubMedCrossRef
26.
go back to reference De Becker W (2007) Starting up a continuous renal replacement therapy program on ICU. Contrib Nephrol 156:185–190PubMed De Becker W (2007) Starting up a continuous renal replacement therapy program on ICU. Contrib Nephrol 156:185–190PubMed
27.
go back to reference Honda CK, Freitas FG, Stanich P, Mazza BF, Castro I, Nascente AP, Bafi AT, Azevedo LC, Machado FR (2013) Nurse to bed ratio and nutrition support in critically ill patients. Am J Crit Care 22:71–78CrossRef Honda CK, Freitas FG, Stanich P, Mazza BF, Castro I, Nascente AP, Bafi AT, Azevedo LC, Machado FR (2013) Nurse to bed ratio and nutrition support in critically ill patients. Am J Crit Care 22:71–78CrossRef
28.
go back to reference Weingart SN, McL Wilson R, Gibberd RW, Harrison B (2000) Epidemiology of medical error. Br Med J 320:774–777CrossRef Weingart SN, McL Wilson R, Gibberd RW, Harrison B (2000) Epidemiology of medical error. Br Med J 320:774–777CrossRef
29.
go back to reference Tarnow-Mordi WO, Hau C, Warden A, Shearer AJ (2000) Hospital mortality in relation to staff workload: a 4 year study in an adult intensive-care unit. Lancet 356:185–189PubMedCrossRef Tarnow-Mordi WO, Hau C, Warden A, Shearer AJ (2000) Hospital mortality in relation to staff workload: a 4 year study in an adult intensive-care unit. Lancet 356:185–189PubMedCrossRef
30.
go back to reference Stone PW, Mooney-Kane C, Larson EL, Horan T, Glance LG, Zwanziger J, Dick AW (2007) Nurse working conditions and patient safety outcome. Med Care 45:571–578PubMedCrossRef Stone PW, Mooney-Kane C, Larson EL, Horan T, Glance LG, Zwanziger J, Dick AW (2007) Nurse working conditions and patient safety outcome. Med Care 45:571–578PubMedCrossRef
31.
go back to reference Kane RL, Shamliyan TA, Mueller C, Duval S, Wilt TJ (2007) The association of registered nurse staffing levels and patient outcome. Systematic review and meta-analysis. Med Care 45:1195–1204PubMedCrossRef Kane RL, Shamliyan TA, Mueller C, Duval S, Wilt TJ (2007) The association of registered nurse staffing levels and patient outcome. Systematic review and meta-analysis. Med Care 45:1195–1204PubMedCrossRef
32.
go back to reference Ward NS, Read R, Afessa B, Kahn JM (2012) Perceived effects of attending physician workload in academic medical intensive care units: a national survey of training program directors. Crit Care Med 40:400–405PubMedCrossRef Ward NS, Read R, Afessa B, Kahn JM (2012) Perceived effects of attending physician workload in academic medical intensive care units: a national survey of training program directors. Crit Care Med 40:400–405PubMedCrossRef
33.
go back to reference Afessa B (2006) Intensive care unit physician staffing: seven days a week, 24 hours a day. Crit Care Med 34:894–895PubMedCrossRef Afessa B (2006) Intensive care unit physician staffing: seven days a week, 24 hours a day. Crit Care Med 34:894–895PubMedCrossRef
34.
go back to reference Dara SI, Afessa B (2005) Intensivist-tobed-ratio: association with outcomes in the medical ICU. Chest 128:567–572PubMedCrossRef Dara SI, Afessa B (2005) Intensivist-tobed-ratio: association with outcomes in the medical ICU. Chest 128:567–572PubMedCrossRef
35.
go back to reference Weiss CH, Moazed F, McEvoy CA, Singer BD, Szleifer I, Amaral LA, Kwasny M, Watts CM, Persell SD, Baker DW, Sznajder JI, Wunderink RG (2011) Prompting physician to address a daily checklist and process of care and clinical outcomes. Am J Respir Crit Care Med 184:680–686PubMedCentralPubMedCrossRef Weiss CH, Moazed F, McEvoy CA, Singer BD, Szleifer I, Amaral LA, Kwasny M, Watts CM, Persell SD, Baker DW, Sznajder JI, Wunderink RG (2011) Prompting physician to address a daily checklist and process of care and clinical outcomes. Am J Respir Crit Care Med 184:680–686PubMedCentralPubMedCrossRef
36.
go back to reference Thomassen O, Storesund A, Softeland E, Brattebo G (2014) The effects of safety checklists in medicine: a systematic review. Acta Anaesthesiol Scand 58:5–18PubMedCrossRef Thomassen O, Storesund A, Softeland E, Brattebo G (2014) The effects of safety checklists in medicine: a systematic review. Acta Anaesthesiol Scand 58:5–18PubMedCrossRef
Metadata
Title
Feasibility and utility of the use of real time random safety audits in adult ICU patients: a multicentre study
Authors
M. Bodí
M. Olona
M. C. Martín
R. Alceaga
J. C. Rodríguez
E. Corral
J. M. Pérez Villares
G. Sirgo
Publication date
01-06-2015
Publisher
Springer Berlin Heidelberg
Published in
Intensive Care Medicine / Issue 6/2015
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-015-3792-3

Other articles of this Issue 6/2015

Intensive Care Medicine 6/2015 Go to the issue