Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2018

Open Access 01-12-2018 | Original research

Assessment of laypersons’ paediatric basic life support and foreign body airway obstruction management skills: a validity study

Authors: Asbjørn Hasselager, Doris Østergaard, Tim Kristensen, Claus Sønderskov, Cathrine Bohnstedt, Torsten L. B. Lauritsen, Lars Konge, Martin G. Tolsgaard

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2018

Login to get access

Abstract

Background

Standardised courses for laypeople in Paediatric Basic Life Support (PBLS) and Foreign Body Airway Obstruction Management (FBAOM) teach essential skills for the initiation of resuscitation by bystanders. Performance assessments are necessary to ensure that skills are acquired. We aimed to examine the validity of developed performance assessments and to determine credible pass/fail standards.

Methods

Validity evidence was gathered in a standardised simulated setting by testing participants with three different levels of PBLS/FBAOM experience: untrained laypersons, trained laypersons, and lifeguards. Two blinded raters assessed participants’ performance. The reliability of test scores was analysed using generalizability theory, scores were compared across the three groups, and pass/fail-standards were established.

Results

A total of 33 participants were included. More than two raters and two cases were necessary for PBLS to achieve a reliability coefficient above 0.80, which is considered the minimally acceptable level for high-stakes certification. For FBAOM, two tests or three raters were needed. Assessment scores differed across the three groups for PBLS skills, as well as for FBAOM skills (p < 0.001).
Pass levels of 74% and 55% of the maximum score for PBLS and FBAOM, respectively, were identified as the levels that best discriminated between competent and non-competent laypersons.

Conclusions

Laypersons’ PBLS and FBAOM skills can be assessed in a reliable and valid way in a standardised simulated setting. However, multiple raters and scenario tests are needed to ensure sufficient reliability, which raises questions regarding the feasibility of performing certification tests for laypersons who participate in short paediatric resuscitation courses.
Appendix
Available only for authorised users
Literature
1.
Kitamura T, Iwami T, Kawamura T, Nagao K, Tanaka H, Nadkarni VM, et al. Conventional and chest-compression-only cardiopulmonary resuscitation by bystanders for children who have out-of-hospital cardiac arrests: a prospective, nationwide, population-based cohort study. Lancet. 2010;375:1347–54.CrossRefPubMed
2.
Naim MY, Burke RV, McNally BF, Song L, Griffis HM, Berg RA, et al. Association of Bystander Cardiopulmonary Resuscitation with Overall and Neurologically Favorable Survival after Pediatric out-of-Hospital Cardiac Arrest in the United States: a report from the cardiac arrest registry to enhance survival surveillance registry. JAMA Pediatr. 2017;171:133–41.CrossRefPubMed
3.
Goto Y, Maeda T, Goto Y. Impact of dispatcher-assisted bystander cardiopulmonary resuscitation on neurological outcomes in children with out-of-hospital cardiac arrests: a prospective, nationwide, population-based cohort study. J Am Heart Assoc. 2014;3:e000499–9.
4.
Maconochie IK, Bingham R, Eich C, López-Herce J, Rodríguez-Núñez A, Rajka T, et al. European resuscitation council guidelines for resuscitation 2015: section 6. Paediatric life support. Resuscitation. 2015;95:223–48.CrossRefPubMed
5.
Donoghue A, Nishisaki A, Sutton R, Hales R, Boulet J. Reliability and validity of a scoring instrument for clinical performance during pediatric advanced life support simulation scenarios. Resuscitation. 2010;81:331–6.CrossRefPubMed
6.
Levy A, Donoghue A, Bailey B, Thompson N, Jamoulle O, Gagnon R, et al. External validation of scoring instruments for evaluating pediatric resuscitation. Simul Healthc. 2014;9:360–9.CrossRefPubMed
7.
Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG, et al. European resuscitation council guidelines for resuscitation 2015: section 10. Education and implementation of resuscitation. Resuscitation. 2015;95:288–301.CrossRefPubMed
8.
Shavit I, Peled S, Steiner IP, Harley DD, Ross S, Tal-Or E, et al. Comparison of outcomes of two skills-teaching methods on lay-rescuers' acquisition of infant basic life support skills. Acad Emerg Med. 2010;17:979–86.CrossRefPubMed
9.
Krogh LQ, Bjørnshave K, Vestergaard LD, Sharma MB, Rasmussen SE, Nielsen HV, et al. E-learning in pediatric basic life support: a randomized controlled non-inferiority study. Resuscitation. 2015;90C:7–12.CrossRef
10.
Hawkes GA, Murphy G, Dempsey EM, Ryan AC. Randomised controlled trial of a mobile phone infant resuscitation guide. J Paediatr Child Health. 2015;51:1084–8.CrossRefPubMed
11.
Peters M, Stipulante S, Delfosse A-S, Schumacher K, Mulder A, Lebrun F, et al. Dispatcher-assisted telephone cardiopulmonary resuscitation using a French-language compression-ventilation pediatric protocol. Pediatr Emerg Care. 2017;33:679–85.CrossRefPubMed
12.
Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119:166.e7–16.CrossRef
13.
Hasselager AB, Lauritsen T, Kristensen T, Bohnstedt C, Sønderskov C, Ostergaard D, et al. What should be included in the assessment of laypersons' paediatric basic life support skills? Results from a Delphi consensus study. Scand J Trauma Resusc Emerg Med. 2018;26:9.CrossRefPubMedPubMedCentral
14.
Cook DA, Zendejas B, Hamstra SJ, Hatala R, Brydges R. What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Adv Health Sci Educ Theory Pract. 2014;19:233–50.CrossRefPubMed
15.
Van Der Vleuten C, Sluijsmans D, Joosten-ten Brinke D. Competence Assessment as Learner Support in Education. Competence-based Vocational and Professional Education. 5 ed. Cham: Springer International Publishing; 2016. p. 607–30.
16.
Bhanji F, Donoghue AJ, Wolff MS, Flores GE, Halamek LP, Berman JM, et al. Part 14: education: 2015 American Heart Association guidelines update for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2015:S561–73.
17.
Association AER, Association AP. National Council on measurement in education., educational JCOSF, S PTU. Standards for educational and psychological testing. 2014 edition. Washington, DC: American Educational Research Association; 2014.
18.
Ilgen JS, Ma IWY, Hatala R, Cook DA. A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Med Educ. 2015;49:161–73.CrossRefPubMed
19.
Bloch R, Norman G. Generalizability theory for the perplexed: a practical introduction and guide: AMEE guide no. 68. Med Teach. 2012;34:960–92.CrossRefPubMed
20.
Ahmed K, Miskovic D, Darzi A, Athanasiou T, Hanna GB. Observational tools for assessment of procedural skills: a systematic review. Am J Surg. 2011;202:469–480.e6.CrossRefPubMed
21.
Mushquash C, O'Connor BP. SPSS and SAS programs for generalizability theory analyses. Behav Res Methods. 2006;38:542–7.CrossRefPubMed
22.
Cook DA. Much ado about differences: why expert-novice comparisons add little to the validity argument. Adv in Health Sci Educ. 2014;20:829–34.CrossRef
23.
Kromann CB, Jensen ML, Ringsted C. The effect of testing on skills learning. Med Educ. 2009;43(1):21–7.CrossRefPubMed
24.
Jørgensen M, Konge L, Subhi Y. Contrasting groups’ standard setting for consequences analysis in validity studies: reporting considerations. Adv Simul. 2018;3:5.CrossRef
25.
Hodges B, Regehr G, McNaughton N, Tiberius R, Hanson M. OSCE checklists do not capture increasing levels of expertise. Acad Med. 1999;74:1129–34.CrossRefPubMed
26.
Berden HJ, Pijls NH, Willems FF, Hendrick JM, Crul JF. A scoring system for basic cardiac life support skills in training situations. Resuscitation. 1992;23:21–31.CrossRefPubMed
27.
Sim MS, Jo IJ, Song HG. Basic cardiac life support education for non-medical hospital employees. Emerg Med J. 2009;26:327–30.CrossRefPubMed
28.
Streiner DL, Norman GR. Reliability. In: Health measurement scales a practical guide to their development and use. New York: Oxford University Press; 2008. p. 167–210.CrossRef
29.
Cook DA, Hatala R. Got power? A systematic review of sample size adequacy in health professions education research. Adv Health Sci Educ Theory Pract. 2015;20:73–83.CrossRefPubMed
30.
Monsieurs KG, Nolan JP, Bossaert LL, Greif R, Maconochie IK, Nikolaou NI, et al. European resuscitation council guidelines for resuscitation 2015: section 1. Executive summary. Resuscitation. 2015:1–80.
Metadata
Title
Assessment of laypersons’ paediatric basic life support and foreign body airway obstruction management skills: a validity study
Authors
Asbjørn Hasselager
Doris Østergaard
Tim Kristensen
Claus Sønderskov
Cathrine Bohnstedt
Torsten L. B. Lauritsen
Lars Konge
Martin G. Tolsgaard
Publication date
01-12-2018
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s13049-018-0544-8

Other articles of this Issue 1/2018

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2018 Go to the issue

Original research

Development and implementation of a geographical area categorisation method with targeted performance indicators for nationwide EMS in Finland

Original research

“Reality rarely looks like the guidelines”: a qualitative study of the challenges hospital-based physicians encounter in war wound management

Letter to the Editor

Ventilation of intubated patients during HEMS hoisting operations

Original research

Head-to-head comparison of qSOFA and SIRS criteria in predicting the mortality of infected patients in the emergency department: a meta-analysis

Commentary

First installation of a dual-room IVR-CT system in the emergency room

Original research

Long-term mortality of acetaminophen poisoning: a nationwide population-based cohort study with 10-year follow-up in Taiwan