Skip to main content
Top
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020

Open Access 01-12-2020 | Cardiopulmonary Resuscitation | Original research

Consistency and variability in human performance during simulate infant CPR: a reliability study

Authors: Debora Almeida, Carol Clark, Michael Jones, Phillip McConnell, Jonathan Williams

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2020

Login to get access

Abstract

Background

Positive outcomes from infant cardiac arrest depend on the effective delivery of resuscitation techniques, including good quality infant cardiopulmonary resuscitation (iCPR) However, it has been established that iCPR skills decay within weeks or months after training. It is not known if the change in performance should be considered true change or inconsistent performance. The aim of this study was to investigate consistency and variability in human performance during iCPR.

Methods

An experimental, prospective, observational study conducted within a university setting with 27 healthcare students (mean (SD) age 32.6 (11.6) years, 74.1% female). On completion of paediatric basic life support (BLS) training, participants performed three trials of 2-min iCPR on a modified infant manikin on two occasions (immediately after training and after 1 week), where performance data were captured. Main outcome measures were within-day and between-day repeated measures reliability estimates, determined using Intraclass Correlation Coefficients (ICCs), Standard Error of Measurement (SEM) and Minimal Detectable Change (MDC95%) for chest compression rate, chest compression depth, residual leaning and duty cycle along with the conversion of these into quality indices according to international guidelines.

Results

A high degree of reliability was found for within-day and between-day for each variable with good to excellent ICCs and narrow confidence intervals. SEM values were low, demonstrating excellent consistency in repeated performance. Within-day MDC values were low for chest compression depth and chest compression rate (6 and 9%) and higher for duty cycle (15%) and residual leaning (22%). Between-day MDC values were low for chest compression depth and chest compression rate (3 and 7%) and higher for duty cycle (21%) and residual leaning (22%). Reliability reduced when metrics were transformed in quality indices.

Conclusion

iCPR skills are highly repeatable and consistent, demonstrating that changes in performance after training can be considered skill decay. However, when the metrics are transformed in quality indices, large changes are required to be confident of real change.
Literature
1.
go back to reference Nolan JP, Berg RA, Callaway CW, Morrison LJ, Nadkarni V, Perkins GD, et al. The present and future of cardiac arrest care: international experts reach out to caregivers and healthcare authorities. Intensive Care Med. 2018;44:823–32.CrossRef Nolan JP, Berg RA, Callaway CW, Morrison LJ, Nadkarni V, Perkins GD, et al. The present and future of cardiac arrest care: international experts reach out to caregivers and healthcare authorities. Intensive Care Med. 2018;44:823–32.CrossRef
2.
go back to reference Holmberg MJ, Ross CE, Fitzmaurice GM, Chan PS, Duval-Arnould J, Grossestreuer AV, et al. Annual incidence of adult and pediatric in-hospital cardiac arrest in the United States. Circulation. 2019;12:e005580.PubMed Holmberg MJ, Ross CE, Fitzmaurice GM, Chan PS, Duval-Arnould J, Grossestreuer AV, et al. Annual incidence of adult and pediatric in-hospital cardiac arrest in the United States. Circulation. 2019;12:e005580.PubMed
3.
go back to reference Wong CX, Brown A, Lau DH, Chug SS, Albert CM, Kalman JM, et al. Epidemiology of sudden cardiac death: global and regional perspectives. Heart Lung Circ. 2019;28:6–14.CrossRef Wong CX, Brown A, Lau DH, Chug SS, Albert CM, Kalman JM, et al. Epidemiology of sudden cardiac death: global and regional perspectives. Heart Lung Circ. 2019;28:6–14.CrossRef
4.
go back to reference Nolan JP. High-quality cardiopulmonary resuscitation. Curr Opin Crit Care. 2014;20:227–33.CrossRef Nolan JP. High-quality cardiopulmonary resuscitation. Curr Opin Crit Care. 2014;20:227–33.CrossRef
5.
go back to reference Perkins GD, SJ B-MD, (On behalf of the OHCAO Project Group). The UK out of hospital cardiac arrest outcome (OHCAO) project. BMJ Open. 2015;5:e008736.CrossRef Perkins GD, SJ B-MD, (On behalf of the OHCAO Project Group). The UK out of hospital cardiac arrest outcome (OHCAO) project. BMJ Open. 2015;5:e008736.CrossRef
6.
go back to reference Hawkes C, Booth S, Ji C, Brace-McDonnell SJ, Whittington A, Mapstone J, et al. Epidemiology and outcomes from out-of-hospital cardiac arrests in England. Resuscitation. 2017;110:133–40.CrossRef Hawkes C, Booth S, Ji C, Brace-McDonnell SJ, Whittington A, Mapstone J, et al. Epidemiology and outcomes from out-of-hospital cardiac arrests in England. Resuscitation. 2017;110:133–40.CrossRef
7.
go back to reference Cummins RO, Chamberlain DA, Abramson NS, Allen M, Baskett PJ, Becker L, et al. Recommended guidelines for uniform report of data from out-of-hospital cardiac arrest: the Utstein style. A statement for health professionals from a task force of the American Heart Association, the European resuscitation council, the Heart and Stroke Foundation of Canada, and the Australian resuscitation council. Circulation. 1991;84:960–5.CrossRef Cummins RO, Chamberlain DA, Abramson NS, Allen M, Baskett PJ, Becker L, et al. Recommended guidelines for uniform report of data from out-of-hospital cardiac arrest: the Utstein style. A statement for health professionals from a task force of the American Heart Association, the European resuscitation council, the Heart and Stroke Foundation of Canada, and the Australian resuscitation council. Circulation. 1991;84:960–5.CrossRef
8.
go back to reference Atkins DL, Everson-Stewart S, Sears GK, Mohamud D, Osmond MH, Warden CR, et al. Epidemiology and outcomes from out-of-hospital cardiac arrest in children: the resuscitation outcomes consortium Epistry-cardiac arrest. Circulation. 2009;119:1484–91.CrossRef Atkins DL, Everson-Stewart S, Sears GK, Mohamud D, Osmond MH, Warden CR, et al. Epidemiology and outcomes from out-of-hospital cardiac arrest in children: the resuscitation outcomes consortium Epistry-cardiac arrest. Circulation. 2009;119:1484–91.CrossRef
9.
go back to reference Sutton RM, Case E, Brown SP, Atkins DL, Nadkarni VM, Kaltman J, et al. A quantitative analysis of out-of-hospital Paediatric and adolescent resuscitation quality–a report from the ROC Epistry–cardiac arrest. Resuscitation. 2015;93:150–7.CrossRef Sutton RM, Case E, Brown SP, Atkins DL, Nadkarni VM, Kaltman J, et al. A quantitative analysis of out-of-hospital Paediatric and adolescent resuscitation quality–a report from the ROC Epistry–cardiac arrest. Resuscitation. 2015;93:150–7.CrossRef
10.
go back to reference Karamaien A. Out-of-hospital cardiac arrests in children. J Emerg Trauma Shock. 2010;3:273–6.CrossRef Karamaien A. Out-of-hospital cardiac arrests in children. J Emerg Trauma Shock. 2010;3:273–6.CrossRef
11.
go back to reference Lurie KG, Nemergut EC, Yannopoulos D, Sweeney M. The physiology of cardiopulmonary resuscitation. Anesth Analg. 2016;122:767–83.CrossRef Lurie KG, Nemergut EC, Yannopoulos D, Sweeney M. The physiology of cardiopulmonary resuscitation. Anesth Analg. 2016;122:767–83.CrossRef
12.
go back to reference Talikowska M, Tohira H, Finn J. Cardiopulmonary resuscitation quality and patient survival outcome in cardiac arrest: a systematic review and meta-analysis. Resuscitation. 2015;96:66–77.CrossRef Talikowska M, Tohira H, Finn J. Cardiopulmonary resuscitation quality and patient survival outcome in cardiac arrest: a systematic review and meta-analysis. Resuscitation. 2015;96:66–77.CrossRef
13.
go back to reference Kramer-Johansen J, Myklebust H, Wik L, Fellows B, Svensson L, Sørebø H, et al. Quality of out-of-hospital cardiopulmonary resuscitation with real time automated feedback: a prospective interventional study. Resuscitation. 2016;71:283–92.CrossRef Kramer-Johansen J, Myklebust H, Wik L, Fellows B, Svensson L, Sørebø H, et al. Quality of out-of-hospital cardiopulmonary resuscitation with real time automated feedback: a prospective interventional study. Resuscitation. 2016;71:283–92.CrossRef
14.
go back to reference Maconochie IK, Bingham B, Skellett S. Paediatric basic life support guidelines. Resuscitation Council UK; 2015. Maconochie IK, Bingham B, Skellett S. Paediatric basic life support guidelines. Resuscitation Council UK; 2015.
15.
go back to reference Niles DE, Duval-Arnould J, Skellett S, Knight L, Su F, Raymond TT, et al. Characterization of Paediatric in-hospital cardiopulmonary resuscitation quality metrics across an international resuscitation collaborative. Pediatr Crit Care Med. 2018;19:421–32.CrossRef Niles DE, Duval-Arnould J, Skellett S, Knight L, Su F, Raymond TT, et al. Characterization of Paediatric in-hospital cardiopulmonary resuscitation quality metrics across an international resuscitation collaborative. Pediatr Crit Care Med. 2018;19:421–32.CrossRef
16.
go back to reference Martin PS, Theobald P, Kemp A, Maguire S, Maconochie I, Jones M. Real-time feedback can improve infant manikin cardiopulmonary resuscitation by up to 79%—a randomised controlled trial. Resuscitation. 2013;84:1125–30.CrossRef Martin PS, Theobald P, Kemp A, Maguire S, Maconochie I, Jones M. Real-time feedback can improve infant manikin cardiopulmonary resuscitation by up to 79%—a randomised controlled trial. Resuscitation. 2013;84:1125–30.CrossRef
17.
go back to reference Donoghue A, Hsieh TC, Myers S, Mak A, Sutton R, Nadkarni V. Videographic assessment of cardiopulmonary resuscitation quality in the pediatric emergency department. Resuscitation. 2015;91:19–25.CrossRef Donoghue A, Hsieh TC, Myers S, Mak A, Sutton R, Nadkarni V. Videographic assessment of cardiopulmonary resuscitation quality in the pediatric emergency department. Resuscitation. 2015;91:19–25.CrossRef
18.
go back to reference Sutton R, Wolfe H, Nishisaki A, Leffelman J, Niles D, Meaney PA, et al. Pushing harder, pushing faster, minimizing interruptions … but falling short of 2010 cardiopulmonary resuscitation targets during in-hospital paediatric and adolescent resuscitation. Resuscitation. 2013;84:1680–4.CrossRef Sutton R, Wolfe H, Nishisaki A, Leffelman J, Niles D, Meaney PA, et al. Pushing harder, pushing faster, minimizing interruptions … but falling short of 2010 cardiopulmonary resuscitation targets during in-hospital paediatric and adolescent resuscitation. Resuscitation. 2013;84:1680–4.CrossRef
19.
go back to reference Niles DE, Sutton RM, Donoghue A, Kalsi MS, Roberts K, Boyle L, et al. “Rolling refreshers”: a novel approach to maintain CPR psychomotor skill competence. Resuscitation. 2009;80:909–12.CrossRef Niles DE, Sutton RM, Donoghue A, Kalsi MS, Roberts K, Boyle L, et al. “Rolling refreshers”: a novel approach to maintain CPR psychomotor skill competence. Resuscitation. 2009;80:909–12.CrossRef
20.
go back to reference Sutton RM, Niles D, Meaney PA, Aplenc R, French B, Abella B, et al. Low-dose, high-frequency CPR training improves skill retention of in-hospital pediatric providers. Pediatrics. 2011;128:145–51.CrossRef Sutton RM, Niles D, Meaney PA, Aplenc R, French B, Abella B, et al. Low-dose, high-frequency CPR training improves skill retention of in-hospital pediatric providers. Pediatrics. 2011;128:145–51.CrossRef
21.
go back to reference Cheng A, Nadkarni VM, Mancini MB, Hunt EA, Sinz EH, Merchant RM, et al. Resuscitation education science: educational strategies to improve outcomes from cardiac arrest: a scientific statement from the American Heart Association. Circulation. 2018;138:82–122.CrossRef Cheng A, Nadkarni VM, Mancini MB, Hunt EA, Sinz EH, Merchant RM, et al. Resuscitation education science: educational strategies to improve outcomes from cardiac arrest: a scientific statement from the American Heart Association. Circulation. 2018;138:82–122.CrossRef
22.
go back to reference Lin Y, Cheng A, Grant VJ, Currie GR, Hecker KG. Improving CPR quality with distributed practice and real-time feedback in paediatric healthcare providers – a randomized controlled trial. Resuscitation. 2018;130:6–12.CrossRef Lin Y, Cheng A, Grant VJ, Currie GR, Hecker KG. Improving CPR quality with distributed practice and real-time feedback in paediatric healthcare providers – a randomized controlled trial. Resuscitation. 2018;130:6–12.CrossRef
23.
go back to reference Anderson R, Sebaldt A, Lin Y, Cheng A. Optimal training frequency for acquisition and retention of high-quality CPR skills: a randomized trial. Resuscitation. 2019;135:153–61.CrossRef Anderson R, Sebaldt A, Lin Y, Cheng A. Optimal training frequency for acquisition and retention of high-quality CPR skills: a randomized trial. Resuscitation. 2019;135:153–61.CrossRef
24.
go back to reference Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Statist Med. 1998;17:101–10.CrossRef Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Statist Med. 1998;17:101–10.CrossRef
25.
go back to reference Bullock I, Davis M, Lockey A, Mackway-Jones K. Pocket Guide to Teaching for Clinical Instructors. 3rd ed. Wiley-Blackwell Publishing; 2015. ISBN:9781118860076. Bullock I, Davis M, Lockey A, Mackway-Jones K. Pocket Guide to Teaching for Clinical Instructors. 3rd ed. Wiley-Blackwell Publishing; 2015. ISBN:9781118860076.
26.
go back to reference Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG. European resuscitation council guidelines for resuscitation 2015: section 10. Education and implementation of resuscitation. Resuscitation. 2015;95:288–301.CrossRef Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG. European resuscitation council guidelines for resuscitation 2015: section 10. Education and implementation of resuscitation. Resuscitation. 2015;95:288–301.CrossRef
27.
go back to reference Martin PS, Kemp AM, Theobald PS, Maguire AS, Jones MD. Does a more “physiological” infant manikin design effect chest compression quality and create a potential for thoracic over-compression during simulated infant CPR? Resuscitation. 2013;84:666–71.CrossRef Martin PS, Kemp AM, Theobald PS, Maguire AS, Jones MD. Does a more “physiological” infant manikin design effect chest compression quality and create a potential for thoracic over-compression during simulated infant CPR? Resuscitation. 2013;84:666–71.CrossRef
28.
go back to reference Kandasamy J. Can infant CPR performance be improved through the provision of ‘real time’ feedback? Doctoral Dissertation. Cardiff University; 2017. Kandasamy J. Can infant CPR performance be improved through the provision of ‘real time’ feedback? Doctoral Dissertation. Cardiff University; 2017.
29.
go back to reference Kandasamy J, Theobald PS, Maconochie IK, Jones MD. Can real-time feedback improve the simulated infant cardiopulmonary resuscitation performance of basic life support and lay rescuers? Arch Dis Child. 2019;104:793–01.CrossRef Kandasamy J, Theobald PS, Maconochie IK, Jones MD. Can real-time feedback improve the simulated infant cardiopulmonary resuscitation performance of basic life support and lay rescuers? Arch Dis Child. 2019;104:793–01.CrossRef
30.
go back to reference Maconochie IK, Bingham R, Eich C, López-Herce J, Rodríguez-Núñez A, Rajka T, et al. European resuscitation council guidelines for resuscitation 2015 section 6 Paediatric life support. Resuscitation. 2015;95:222–47.CrossRef Maconochie IK, Bingham R, Eich C, López-Herce J, Rodríguez-Núñez A, Rajka T, et al. European resuscitation council guidelines for resuscitation 2015 section 6 Paediatric life support. Resuscitation. 2015;95:222–47.CrossRef
31.
go back to reference Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15:155–63..CrossRef Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15:155–63..CrossRef
32.
go back to reference Willingham DB. A neuropsychological theory of motor skill learning. Psychol Rev. 1998;105:558–84.CrossRef Willingham DB. A neuropsychological theory of motor skill learning. Psychol Rev. 1998;105:558–84.CrossRef
33.
go back to reference Chung TN, Bae J, Kim EC, Cho YK, You JS, Choi SW, et al. Induction of a shorter compression phase is correlated with a deeper chest compression during metronome-guided cardiopulmonary resuscitation: a manikin study. EMJ. 2013;30:551–4.CrossRef Chung TN, Bae J, Kim EC, Cho YK, You JS, Choi SW, et al. Induction of a shorter compression phase is correlated with a deeper chest compression during metronome-guided cardiopulmonary resuscitation: a manikin study. EMJ. 2013;30:551–4.CrossRef
34.
go back to reference Cheng A, Hunt EA, Grant D, Lin Y, Grant V, Diff JP, et al. Variability in quality of chest compressions provided during simulated cardiac arrest across nine paediatric institutions. Resuscitation. 2015;97:13–9.CrossRef Cheng A, Hunt EA, Grant D, Lin Y, Grant V, Diff JP, et al. Variability in quality of chest compressions provided during simulated cardiac arrest across nine paediatric institutions. Resuscitation. 2015;97:13–9.CrossRef
35.
go back to reference Garcia-Jorda D, Walker A, Camphaug J, Bissett W, Spence T, Martin D, et al. Bedside chest compression skills: performance and skills retention in in-hospital trained paediatric providers. A simulation study. J Crit Care. 2019;50:132–7.CrossRef Garcia-Jorda D, Walker A, Camphaug J, Bissett W, Spence T, Martin D, et al. Bedside chest compression skills: performance and skills retention in in-hospital trained paediatric providers. A simulation study. J Crit Care. 2019;50:132–7.CrossRef
Metadata
Title
Consistency and variability in human performance during simulate infant CPR: a reliability study
Authors
Debora Almeida
Carol Clark
Michael Jones
Phillip McConnell
Jonathan Williams
Publication date
01-12-2020
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s13049-020-00785-y

Other articles of this Issue 1/2020

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020 Go to the issue