Skip to main content
Top
Published in:

Open Access 01-12-2023 | Cardiopulmonary Resuscitation | Research

Association between cardiopulmonary resuscitation audit results with in-situ simulation and in-hospital cardiac arrest outcomes and key performance indicators

Authors: Onlak Ruangsomboon, Usapan Surabenjawongse, Pongthorn Jantataeme, Thanawin Chawaruechai, Khemchat Wangtawesap, Tipa Chakorn

Published in: BMC Cardiovascular Disorders | Issue 1/2023

Login to get access

Abstract

Introduction

In-situ simulation (ISS) is a method to evaluate the performance of hospital units in performing cardiopulmonary resuscitation (CPR). It is conducted by placing a high-fidelity mannequin at hospital units with simulated scenarios and having each unit’s performance evaluated. However, little is known about its impact on actual patient outcomes. Therefore, we aimed to evaluate the association between the ISS results and actual outcomes of patients with in-hospital cardiac arrest (IHCA).

Methods

This retrospective study was conducted by reviewing Siriraj Hospital’s CPR ISS results in association with the data of IHCA patients between January 2012 and January 2019. Actual outcomes were determined by patients’ outcomes (sustained return of spontaneous circulation (ROSC) and survival to hospital discharge) and arrest performance indicators (time-to-first-epinephrine and time-to-defibrillation). These outcomes were investigated for association with the ISS scores in multilevel regression models with hospital units as clusters.

Results

There were 2146 cardiac arrests included with sustained ROSC rate of 65.3% and survival to hospital discharge rate of 12.9%. Higher ISS scores were significantly associated with improved sustained ROSC rate (adjusted odds ratio 1.32 (95%CI 1.04, 1.67); p = 0.01) and a decrease in time-to-defibrillation (-0.42 (95%CI -0.73, -0.11); p = 0.009). Although higher scores were also associated with better survival to hospital discharge and a decrease in time-to-first-epinephrine, most models for these outcomes failed to reach statistical significance.

Conclusion

CPR ISS results were associated with some important patient outcomes and arrest performance indicators. Therefore, it may be an appropriate performance evaluation method that can guide the direction of improvement.
Appendix
Available only for authorised users
Literature
1.
go back to reference Peberdy MA, Kaye W, Ornato JP, Larkin GL, Nadkarni V, Mancini ME, et al. Cardiopulmonary resuscitation of adults in the hospital: a report of 14 720 cardiac arrests from the National Registry of Cardiopulmonary Resuscitation. Resuscitation. 2003 Sep;58(3):297–308. Peberdy MA, Kaye W, Ornato JP, Larkin GL, Nadkarni V, Mancini ME, et al. Cardiopulmonary resuscitation of adults in the hospital: a report of 14 720 cardiac arrests from the National Registry of Cardiopulmonary Resuscitation. Resuscitation. 2003 Sep;58(3):297–308.
2.
go back to reference Tunstall-Pedoe H, Bailey L, Chamberlain DA, Marsden AK, Ward ME, Zideman DA. Survey of 3765 cardiopulmonary resuscitations in british hospitals (the BRESUS Study): methods and overall results. BMJ. 1992 May;23(6838):1347–51. Tunstall-Pedoe H, Bailey L, Chamberlain DA, Marsden AK, Ward ME, Zideman DA. Survey of 3765 cardiopulmonary resuscitations in british hospitals (the BRESUS Study): methods and overall results. BMJ. 1992 May;23(6838):1347–51.
3.
go back to reference Allen T, Walshe K, Proudlove N, Sutton M. Measurement and improvement of emergency department performance through inspection and rating: an observational study of emergency departments in acute hospitals in England. Emerg Med J. 2019 Jun;36(6):326–32. Allen T, Walshe K, Proudlove N, Sutton M. Measurement and improvement of emergency department performance through inspection and rating: an observational study of emergency departments in acute hospitals in England. Emerg Med J. 2019 Jun;36(6):326–32.
4.
go back to reference Flodgren G, Pomey MP, Taber SA, Eccles MP. Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. Cochrane Database Syst Rev. 2011 Nov 9;(11):CD008992. Flodgren G, Pomey MP, Taber SA, Eccles MP. Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. Cochrane Database Syst Rev. 2011 Nov 9;(11):CD008992.
5.
go back to reference Brubakk K, Vist GE, Bukholm G, Barach P, Tjomsland O. A systematic review of hospital accreditation: the challenges of measuring complex intervention effects. BMC Health Serv Res. 2015 Jul 23;15:280. Brubakk K, Vist GE, Bukholm G, Barach P, Tjomsland O. A systematic review of hospital accreditation: the challenges of measuring complex intervention effects. BMC Health Serv Res. 2015 Jul 23;15:280.
6.
go back to reference McLaughlin S, Fitch MT, Goyal DG, Hayden E, Kauh CY, Laack TA, et al. Simulation in graduate medical education 2008: a review for emergency medicine. Acad Emerg Med. 2008 Nov;15(11):1117–29. McLaughlin S, Fitch MT, Goyal DG, Hayden E, Kauh CY, Laack TA, et al. Simulation in graduate medical education 2008: a review for emergency medicine. Acad Emerg Med. 2008 Nov;15(11):1117–29.
7.
go back to reference Murphy M, Curtis K, McCloughen A. What is the impact of multidisciplinary team simulation training on team performance and efficiency of patient care? An integrative review. Australas Emerg Nurs J. 2016 Feb;19(1):44–53. Murphy M, Curtis K, McCloughen A. What is the impact of multidisciplinary team simulation training on team performance and efficiency of patient care? An integrative review. Australas Emerg Nurs J. 2016 Feb;19(1):44–53.
8.
go back to reference Rutherford-Hemming T, Nye C, Coram C. Using Simulation for clinical practice hours in nurse Practitioner Education in the United States: a systematic review. Nurse Educ Today. 2016 Feb;37:128–35. Rutherford-Hemming T, Nye C, Coram C. Using Simulation for clinical practice hours in nurse Practitioner Education in the United States: a systematic review. Nurse Educ Today. 2016 Feb;37:128–35.
9.
go back to reference Boling B, Hardin-Pierce M. The effect of high-fidelity simulation on knowledge and confidence in critical care training: an integrative review. Nurse Educ Pract. 2016 Jan;16(1):287–93. Boling B, Hardin-Pierce M. The effect of high-fidelity simulation on knowledge and confidence in critical care training: an integrative review. Nurse Educ Pract. 2016 Jan;16(1):287–93.
10.
go back to reference Nolan JP, Soar J, Zideman DA, Biarent D, Bossaert LL, Deakin C, et al. European Resuscitation Council Guidelines for Resuscitation 2010 Sect. 1. Executive summary. Resuscitation. 2010 Oct;81(10):1219–76. Nolan JP, Soar J, Zideman DA, Biarent D, Bossaert LL, Deakin C, et al. European Resuscitation Council Guidelines for Resuscitation 2010 Sect. 1. Executive summary. Resuscitation. 2010 Oct;81(10):1219–76.
11.
go back to reference Walker ST, Sevdalis N, McKay A, Lambden S, Gautama S, Aggarwal R, et al. Unannounced in situ simulations: integrating training and clinical practice. BMJ Qual Saf. 2013 Jun;22(6):453–8. Walker ST, Sevdalis N, McKay A, Lambden S, Gautama S, Aggarwal R, et al. Unannounced in situ simulations: integrating training and clinical practice. BMJ Qual Saf. 2013 Jun;22(6):453–8.
12.
go back to reference Nishisaki A, Scrattish L, Boulet J, Kalsi M, Maltese M, Castner T et al. Effect of Recent Refresher Training on in Situ Simulated Pediatric Tracheal Intubation Psychomotor Skill Performance. In: Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol 3: Performance and Tools) [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2008 [cited 2022 Apr 6]. (Advances in Patient Safety). Available from: http://www.ncbi.nlm.nih.gov/books/NBK43657/. Nishisaki A, Scrattish L, Boulet J, Kalsi M, Maltese M, Castner T et al. Effect of Recent Refresher Training on in Situ Simulated Pediatric Tracheal Intubation Psychomotor Skill Performance. In: Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol 3: Performance and Tools) [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2008 [cited 2022 Apr 6]. (Advances in Patient Safety). Available from: http://​www.​ncbi.​nlm.​nih.​gov/​books/​NBK43657/​.
13.
go back to reference Sørensen JL, Navne LE, Martin HM, Ottesen B, Albrecthsen CK, Pedersen BW et al. Clarifying the learning experiences of healthcare professionals with in situ and off-site simulation-based medical education: a qualitative study. BMJ Open. 2015 Oct 6;5(10):e008345. Sørensen JL, Navne LE, Martin HM, Ottesen B, Albrecthsen CK, Pedersen BW et al. Clarifying the learning experiences of healthcare professionals with in situ and off-site simulation-based medical education: a qualitative study. BMJ Open. 2015 Oct 6;5(10):e008345.
14.
go back to reference Cheng A, Kessler D, Mackinnon R, Chang TP, Nadkarni VM, Hunt EA et al. Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements. Adv Simul 2016 Jul 25;1(1):25. Cheng A, Kessler D, Mackinnon R, Chang TP, Nadkarni VM, Hunt EA et al. Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements. Adv Simul 2016 Jul 25;1(1):25.
15.
go back to reference Field JM, Hazinski MF, Sayre MR, Chameides L, Schexnayder SM, Hemphill R et al. Part 1: executive summary: 2010 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2010 Nov 2;122(18 Suppl 3):S640-656. Field JM, Hazinski MF, Sayre MR, Chameides L, Schexnayder SM, Hemphill R et al. Part 1: executive summary: 2010 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2010 Nov 2;122(18 Suppl 3):S640-656.
16.
go back to reference Neumar RW, Shuster M, Callaway CW, Gent LM, Atkins DL, Bhanji F et al. Part 1: Executive Summary: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015 Nov 3;132(18 Suppl 2):S315-367. Neumar RW, Shuster M, Callaway CW, Gent LM, Atkins DL, Bhanji F et al. Part 1: Executive Summary: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015 Nov 3;132(18 Suppl 2):S315-367.
17.
go back to reference Nolan JP, Berg RA, Andersen LW, Bhanji F, Chan PS, Donnino MW, the International Liaison Committee on Resuscitation (American Heart Association. Cardiac Arrest and Cardiopulmonary Resuscitation Outcome Reports: Update of the Utstein Resuscitation Registry Template for In-Hospital Cardiac Arrest: A Consensus Report From a Task Force of, European Resuscitation Council, Australian and New Zealand Council on Resuscitation, Heart and Stroke Foundation of Canada, InterAmerican Heart Foundation, Resuscitation Council of Southern Africa, Resuscitation Council of Asia). Circulation. 2019 Oct 29;140(18):e746–57. Nolan JP, Berg RA, Andersen LW, Bhanji F, Chan PS, Donnino MW, the International Liaison Committee on Resuscitation (American Heart Association. Cardiac Arrest and Cardiopulmonary Resuscitation Outcome Reports: Update of the Utstein Resuscitation Registry Template for In-Hospital Cardiac Arrest: A Consensus Report From a Task Force of, European Resuscitation Council, Australian and New Zealand Council on Resuscitation, Heart and Stroke Foundation of Canada, InterAmerican Heart Foundation, Resuscitation Council of Southern Africa, Resuscitation Council of Asia). Circulation. 2019 Oct 29;140(18):e746–57.
18.
go back to reference Larsen K, Petersen JH, Budtz-Jørgensen E, Endahl L. Interpreting parameters in the logistic regression model with random effects. Biometrics. 2000 Sep;56(3):909–14. Larsen K, Petersen JH, Budtz-Jørgensen E, Endahl L. Interpreting parameters in the logistic regression model with random effects. Biometrics. 2000 Sep;56(3):909–14.
19.
go back to reference Leyland and Groenewegen. Multilevel Modelling for Public Health and Health Services Research: Health in Context. Springer Open. 2020. P.144–145. In. Leyland and Groenewegen. Multilevel Modelling for Public Health and Health Services Research: Health in Context. Springer Open. 2020. P.144–145. In.
20.
go back to reference Bingenheimer JB, Raudenbush SW. Statistical and substantive inferences in public health: issues in the application of multilevel models. Annu Rev Public Health. 2004;25:53–77.CrossRefPubMed Bingenheimer JB, Raudenbush SW. Statistical and substantive inferences in public health: issues in the application of multilevel models. Annu Rev Public Health. 2004;25:53–77.CrossRefPubMed
21.
go back to reference Austin PC, Leckie G. The effect of number of clusters and cluster size on statistical power and type I error rates when testing random effects variance components in multilevel linear and logistic regression models. J Stat Comput Simul. 2018 Nov;88(2):3151–63. Austin PC, Leckie G. The effect of number of clusters and cluster size on statistical power and type I error rates when testing random effects variance components in multilevel linear and logistic regression models. J Stat Comput Simul. 2018 Nov;88(2):3151–63.
22.
go back to reference Bell BA, Morgan GB, Kromrey JD, Ferron JM. The Impact of Small Cluster Size on Multilevel Models: A Monte Carlo Examination of Two-Level Models with Binary and Continuous Predictors. 2010;11. Bell BA, Morgan GB, Kromrey JD, Ferron JM. The Impact of Small Cluster Size on Multilevel Models: A Monte Carlo Examination of Two-Level Models with Binary and Continuous Predictors. 2010;11.
23.
24.
go back to reference Popa TO, Nedelea P, Bouros C, Corlade M, Grigorasi G, Haisan A, et al. Simulation of cardiac arrest cases: a pathway for improving the ERC ALS algorithm teaching and learning on medical students. Resuscitation. 2019 Sep;142(1):e69–70. Popa TO, Nedelea P, Bouros C, Corlade M, Grigorasi G, Haisan A, et al. Simulation of cardiac arrest cases: a pathway for improving the ERC ALS algorithm teaching and learning on medical students. Resuscitation. 2019 Sep;142(1):e69–70.
25.
go back to reference Petrosoniak A, Hicks CM. Beyond crisis resource management: new frontiers in human factors training for acute care medicine. Curr Opin Anaesthesiol. 2013 Dec;26(6):699–706. Petrosoniak A, Hicks CM. Beyond crisis resource management: new frontiers in human factors training for acute care medicine. Curr Opin Anaesthesiol. 2013 Dec;26(6):699–706.
26.
go back to reference Petrosoniak A, Fan M, Hicks CM, White K, McGowan M, Campbell D, et al. Trauma resuscitation using in situ Simulation Team Training (TRUST) study: latent safety threat evaluation using framework analysis and video review. BMJ Qual Saf. 2021 Sep;30(9):739–46. Petrosoniak A, Fan M, Hicks CM, White K, McGowan M, Campbell D, et al. Trauma resuscitation using in situ Simulation Team Training (TRUST) study: latent safety threat evaluation using framework analysis and video review. BMJ Qual Saf. 2021 Sep;30(9):739–46.
27.
go back to reference Bentley SK, Meshel A, Boehm L, Dilos B, McIndoe M, Carroll-Bennett R et al. Hospital-wide cardiac arrest in situ simulation to identify and mitigate latent safety threats. Adv Simul (Lond). 2022 May 21;7(1):15. Bentley SK, Meshel A, Boehm L, Dilos B, McIndoe M, Carroll-Bennett R et al. Hospital-wide cardiac arrest in situ simulation to identify and mitigate latent safety threats. Adv Simul (Lond). 2022 May 21;7(1):15.
28.
go back to reference Cheng A, Auerbach M, Hunt EA, Chang TP, Pusic M, Nadkarni V, et al. Designing and conducting simulation-based research. Pediatrics. 2014 Jun;133(6):1091–101. Cheng A, Auerbach M, Hunt EA, Chang TP, Pusic M, Nadkarni V, et al. Designing and conducting simulation-based research. Pediatrics. 2014 Jun;133(6):1091–101.
29.
go back to reference Meaney PA, Bobrow BJ, Mancini ME, Christenson J, de Caen AR, Bhanji F et al. Cardiopulmonary resuscitation quality: [corrected] improving cardiac resuscitation outcomes both inside and outside the hospital: a consensus statement from the American Heart Association. Circulation. 2013 Jul 23;128(4):417–35. Meaney PA, Bobrow BJ, Mancini ME, Christenson J, de Caen AR, Bhanji F et al. Cardiopulmonary resuscitation quality: [corrected] improving cardiac resuscitation outcomes both inside and outside the hospital: a consensus statement from the American Heart Association. Circulation. 2013 Jul 23;128(4):417–35.
30.
go back to reference Ilgen JS, Sherbino J, Cook DA. Technology-enhanced simulation in emergency medicine: a systematic review and meta-analysis. Acad Emerg Med. 2013 Feb;20(2):117–27. Ilgen JS, Sherbino J, Cook DA. Technology-enhanced simulation in emergency medicine: a systematic review and meta-analysis. Acad Emerg Med. 2013 Feb;20(2):117–27.
31.
go back to reference Chen LM, Nallamothu BK, Spertus JA, Li Y, Chan PS. American Heart Association’s get with the Guidelines-Resuscitation (formerly the National Registry of Cardiopulmonary Resuscitation) investigators. Association between a hospital’s rate of cardiac arrest incidence and cardiac arrest survival. JAMA Intern Med. 2013 Jul;8(13):1186–95. Chen LM, Nallamothu BK, Spertus JA, Li Y, Chan PS. American Heart Association’s get with the Guidelines-Resuscitation (formerly the National Registry of Cardiopulmonary Resuscitation) investigators. Association between a hospital’s rate of cardiac arrest incidence and cardiac arrest survival. JAMA Intern Med. 2013 Jul;8(13):1186–95.
32.
go back to reference Al-Dury N, Rawshani A, Israelsson J, Strömsöe A, Aune S, Agerström J et al. Characteristics and outcome among 14,933 adult cases of in-hospital cardiac arrest: a nationwide study with the emphasis on gender and age. Am J Emerg Med. 2017;6. Al-Dury N, Rawshani A, Israelsson J, Strömsöe A, Aune S, Agerström J et al. Characteristics and outcome among 14,933 adult cases of in-hospital cardiac arrest: a nationwide study with the emphasis on gender and age. Am J Emerg Med. 2017;6.
33.
go back to reference Nolan JP, Soar J, Smith GB, Gwinnutt C, Parrott F, Power S, et al. Incidence and outcome of in-hospital cardiac arrest in the United Kingdom National Cardiac arrest audit. Resuscitation. 2014 Aug;85(8):987–92. Nolan JP, Soar J, Smith GB, Gwinnutt C, Parrott F, Power S, et al. Incidence and outcome of in-hospital cardiac arrest in the United Kingdom National Cardiac arrest audit. Resuscitation. 2014 Aug;85(8):987–92.
34.
go back to reference Chen CT. Prognostic factors for survival outcome after in-hospital cardiac arrest: an observational study of the oriental population in Taiwan. J Chin Med Association. 2016;6. Chen CT. Prognostic factors for survival outcome after in-hospital cardiac arrest: an observational study of the oriental population in Taiwan. J Chin Med Association. 2016;6.
35.
go back to reference Chon GR, Lee J, Shin Y, Huh JW, Lim CM, Koh Y, et al. Clinical outcomes of witnessed and monitored cases of in-hospital cardiac arrest in the general ward of a university hospital in Korea. Respir Care. 2013 Nov;58(11):1937–44. Chon GR, Lee J, Shin Y, Huh JW, Lim CM, Koh Y, et al. Clinical outcomes of witnessed and monitored cases of in-hospital cardiac arrest in the general ward of a university hospital in Korea. Respir Care. 2013 Nov;58(11):1937–44.
Metadata
Title
Association between cardiopulmonary resuscitation audit results with in-situ simulation and in-hospital cardiac arrest outcomes and key performance indicators
Authors
Onlak Ruangsomboon
Usapan Surabenjawongse
Pongthorn Jantataeme
Thanawin Chawaruechai
Khemchat Wangtawesap
Tipa Chakorn
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Cardiovascular Disorders / Issue 1/2023
Electronic ISSN: 1471-2261
DOI
https://doi.org/10.1186/s12872-023-03320-w

Other articles of this Issue 1/2023

BMC Cardiovascular Disorders 1/2023 Go to the issue

A quick guide to ECGs

Improve your ECG interpretation skills with this comprehensive, rapid, interactive course. Expert advice provides detailed feedback as you work through 50 ECGs covering the most common cardiac presentations to ensure your practice stays up to date. 

PD Dr. Carsten W. Israel
Developed by: Springer Medizin
Start the cases

Keynote webinar | Spotlight on medication adherence

  • Webinar | 27-06-2024 | 18:00 (CEST)

Medication non-adherence is a major barrier to effective healthcare delivery; half of all patients do not follow their doctor’s recommendations or treatment plan.

Our experts explain the fundamentals with a practical discussion of how to manage non-adherence in two common scenarios: hypertension and asthma control.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Watch now