Skip to main content
Top
Published in: Critical Care 4/2011

Open Access 01-08-2011 | Research

Multicentre validation of the bedside paediatric early warning system score: a severity of illness score to detect evolving critical illness in hospitalised children

Authors: Christopher S Parshuram, Heather P Duncan, Ari R Joffe, Catherine A Farrell, Jacques R Lacroix, Kristen L Middaugh, James S Hutchison, David Wensley, Nadeene Blanchard, Joseph Beyene, Patricia C Parkin

Published in: Critical Care | Issue 4/2011

Login to get access

Abstract

Introduction

The timely provision of critical care to hospitalised patients at risk for cardiopulmonary arrest is contingent upon identification and referral by frontline providers. Current approaches require improvement. In a single-centre study, we developed the Bedside Paediatric Early Warning System (Bedside PEWS) score to identify patients at risk. The objective of this study was to validate the Bedside PEWS score in a large patient population at multiple hospitals.

Methods

We performed an international, multicentre, case-control study of children admitted to hospital inpatient units with no limitations on care. Case patients had experienced a clinical deterioration event involving either an immediate call to a resuscitation team or urgent admission to a paediatric intensive care unit. Control patients had no events. The scores ranged from 0 to 26 and were assessed in the 24 hours prior to the clinical deterioration event. Score performance was assessed using the area under the receiver operating characteristic (AUCROC) curve by comparison with the retrospective rating of nurses and the temporal progression of scores in case patients.

Results

A total of 2,074 patients were evaluated at 4 participating hospitals. The median (interquartile range) maximum Bedside PEWS scores for the 12 hours ending 1 hour before the clinical deterioration event were 8 (5 to 12) in case patients and 2 (1 to 4) in control patients (P < 0.0001). The AUCROC curve (95% confidence interval) was 0.87 (0.85 to 0.89). In case patients, mean scores were 5.3 at 20 to 24 hours and 8.4 at 0 to 4 hours before the event (P < 0.0001). The AUCROC curve (95% CI) of the retrospective nurse ratings was 0.83 (0.81 to 0.86). This was significantly lower than that of the Bedside PEWS score (P < 0.0001).

Conclusions

The Bedside PEWS score identified children at risk for cardiopulmonary arrest. Scores were elevated and continued to increase in the 24 hours before the clinical deterioration event. Prospective clinical evaluation is needed to determine whether this score will improve the quality of care and patient outcomes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sharek PJ, Parast LM, Leong K, Coombs J, Earnest K, Sullivan J, Frankel LR, Roth SJ: Effect of a rapid response team on hospital-wide mortality and code rates outside the ICU in a children's hospital. JAMA 2007, 298: 2267-2274. 10.1001/jama.298.19.2267PubMedCrossRef Sharek PJ, Parast LM, Leong K, Coombs J, Earnest K, Sullivan J, Frankel LR, Roth SJ: Effect of a rapid response team on hospital-wide mortality and code rates outside the ICU in a children's hospital. JAMA 2007, 298: 2267-2274. 10.1001/jama.298.19.2267PubMedCrossRef
2.
go back to reference Buist MD, Moore GE, Bernard SA, Waxman BP, Anderson JN, Nguyen TV: Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study. BMJ 2002, 324: 387-390.PubMedPubMedCentralCrossRef Buist MD, Moore GE, Bernard SA, Waxman BP, Anderson JN, Nguyen TV: Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study. BMJ 2002, 324: 387-390.PubMedPubMedCentralCrossRef
3.
go back to reference Carcillo JA, Davis AL, Zaritsky A: Role of early fluid resuscitation in pediatric septic shock. JAMA 1991, 266: 1242-1245. 10.1001/jama.266.9.1242PubMedCrossRef Carcillo JA, Davis AL, Zaritsky A: Role of early fluid resuscitation in pediatric septic shock. JAMA 1991, 266: 1242-1245. 10.1001/jama.266.9.1242PubMedCrossRef
4.
go back to reference Han YY, Carcillo JA, Dragotta MA, Bills DM, Watson RS, Westerman ME, Orr RA: Early reversal of pediatric-neonatal septic shock by community physicians is associated with improved outcome. Pediatrics 2003, 112: 793-799. 10.1542/peds.112.4.793PubMedCrossRef Han YY, Carcillo JA, Dragotta MA, Bills DM, Watson RS, Westerman ME, Orr RA: Early reversal of pediatric-neonatal septic shock by community physicians is associated with improved outcome. Pediatrics 2003, 112: 793-799. 10.1542/peds.112.4.793PubMedCrossRef
5.
go back to reference Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A: Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet 2005, 365: 2091-2097.PubMedCrossRef Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A: Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet 2005, 365: 2091-2097.PubMedCrossRef
6.
go back to reference Parshuram CS, Hutchison J, Middaugh K: Development and initial validation of the Bedside Paediatric Early Warning System score. Crit Care 2009, 13: R135. 10.1186/cc7998PubMedPubMedCentralCrossRef Parshuram CS, Hutchison J, Middaugh K: Development and initial validation of the Bedside Paediatric Early Warning System score. Crit Care 2009, 13: R135. 10.1186/cc7998PubMedPubMedCentralCrossRef
7.
go back to reference Suominen P, Olkkola KT, Voipio V, Korpela R, Palo R, Räsänen J: Utstein style reporting of in-hospital paediatric cardiopulmonary resuscitation. Resuscitation 2000, 45: 17-25. 10.1016/S0300-9572(00)00167-2PubMedCrossRef Suominen P, Olkkola KT, Voipio V, Korpela R, Palo R, Räsänen J: Utstein style reporting of in-hospital paediatric cardiopulmonary resuscitation. Resuscitation 2000, 45: 17-25. 10.1016/S0300-9572(00)00167-2PubMedCrossRef
8.
go back to reference Reis AG, Nadkarni V, Perondi MB, Grisi S, Berg RA: A prospective investigation into the epidemiology of in-hospital pediatric cardiopulmonary resuscitation using the international Utstein reporting style. Pediatrics 2002, 109: 200-209. 10.1542/peds.109.2.200PubMedCrossRef Reis AG, Nadkarni V, Perondi MB, Grisi S, Berg RA: A prospective investigation into the epidemiology of in-hospital pediatric cardiopulmonary resuscitation using the international Utstein reporting style. Pediatrics 2002, 109: 200-209. 10.1542/peds.109.2.200PubMedCrossRef
9.
go back to reference Tibballs J, Kinney S, Duke T, Oakley E, Hennessy M: Reduction of paediatric in-patient cardiac arrest and death with a medical emergency team: preliminary results. Arch Dis Child 2005, 90: 1148-1152. 10.1136/adc.2004.069401PubMedPubMedCentralCrossRef Tibballs J, Kinney S, Duke T, Oakley E, Hennessy M: Reduction of paediatric in-patient cardiac arrest and death with a medical emergency team: preliminary results. Arch Dis Child 2005, 90: 1148-1152. 10.1136/adc.2004.069401PubMedPubMedCentralCrossRef
10.
go back to reference Nadkarni VM, Larkin GL, Peberdy MA, Carey SM, Kaye W, Mancini ME, Nichol G, Lane-Truitt T, Potts J, Ornato JP, Berg RA: First documented rhythm and clinical outcome from in-hospital cardiac arrest among children and adults. JAMA 2006, 295: 50-57. 10.1001/jama.295.1.50PubMedCrossRef Nadkarni VM, Larkin GL, Peberdy MA, Carey SM, Kaye W, Mancini ME, Nichol G, Lane-Truitt T, Potts J, Ornato JP, Berg RA: First documented rhythm and clinical outcome from in-hospital cardiac arrest among children and adults. JAMA 2006, 295: 50-57. 10.1001/jama.295.1.50PubMedCrossRef
11.
go back to reference Bloom AA, Wright JA, Morris RD, Campbell RM, Krawiecki NS: Additive impact of in-hospital cardiac arrest on the functioning of children with heart disease. Pediatrics 1997, 99: 390-398. 10.1542/peds.99.3.390PubMedCrossRef Bloom AA, Wright JA, Morris RD, Campbell RM, Krawiecki NS: Additive impact of in-hospital cardiac arrest on the functioning of children with heart disease. Pediatrics 1997, 99: 390-398. 10.1542/peds.99.3.390PubMedCrossRef
12.
go back to reference Schindler MB, Bohn D, Cox PN, McCrindle BW, Jarvis A, Edmonds J, Barker G: Outcome of out-of-hospital cardiac or respiratory arrest in children. N Engl J Med 1996, 335: 1473-1479. 10.1056/NEJM199611143352001PubMedCrossRef Schindler MB, Bohn D, Cox PN, McCrindle BW, Jarvis A, Edmonds J, Barker G: Outcome of out-of-hospital cardiac or respiratory arrest in children. N Engl J Med 1996, 335: 1473-1479. 10.1056/NEJM199611143352001PubMedCrossRef
13.
go back to reference Gillis J, Dickson D, Rieder M, Steward D, Edmonds J: Results of inpatient pediatric resuscitation. Crit Care Med 1986, 14: 469-471. 10.1097/00003246-198605000-00007PubMedCrossRef Gillis J, Dickson D, Rieder M, Steward D, Edmonds J: Results of inpatient pediatric resuscitation. Crit Care Med 1986, 14: 469-471. 10.1097/00003246-198605000-00007PubMedCrossRef
14.
go back to reference Lundgren-Nilsson A, Rosén H, Hofgren C, Sunnerhagen KS: The first year after successful cardiac resuscitation: function, activity, participation and quality of life. Resuscitation 2005, 66: 285-289. 10.1016/j.resuscitation.2005.04.001PubMedCrossRef Lundgren-Nilsson A, Rosén H, Hofgren C, Sunnerhagen KS: The first year after successful cardiac resuscitation: function, activity, participation and quality of life. Resuscitation 2005, 66: 285-289. 10.1016/j.resuscitation.2005.04.001PubMedCrossRef
15.
go back to reference Bayer AJ, Ang BC, Pathy MS: Cardiac arrests in a geriatric unit. Age Ageing 1985, 14: 271-276. 10.1093/ageing/14.5.271PubMedCrossRef Bayer AJ, Ang BC, Pathy MS: Cardiac arrests in a geriatric unit. Age Ageing 1985, 14: 271-276. 10.1093/ageing/14.5.271PubMedCrossRef
16.
go back to reference Hodgetts TJ, Kenward G, Vlachonikolis IG, Payne S, Castle N: The identification of risk factors for cardiac arrest and formulation of activation criteria to alert a medical emergency team. Resuscitation 2002, 54: 125-131. 10.1016/S0300-9572(02)00100-4PubMedCrossRef Hodgetts TJ, Kenward G, Vlachonikolis IG, Payne S, Castle N: The identification of risk factors for cardiac arrest and formulation of activation criteria to alert a medical emergency team. Resuscitation 2002, 54: 125-131. 10.1016/S0300-9572(02)00100-4PubMedCrossRef
17.
go back to reference Duncan H, Hutchison J, Parshuram CS: The Pediatric Early Warning System score: A severity of illness score to predict urgent medical need in hospitalized children. J Crit Care 2006, 21: 271-278. 10.1016/j.jcrc.2006.06.007PubMedCrossRef Duncan H, Hutchison J, Parshuram CS: The Pediatric Early Warning System score: A severity of illness score to predict urgent medical need in hospitalized children. J Crit Care 2006, 21: 271-278. 10.1016/j.jcrc.2006.06.007PubMedCrossRef
18.
go back to reference Tume L: The deterioration of children in ward areas in a specialist children's hospital. Nurs Crit Care 2007, 12: 12-19. 10.1111/j.1478-5153.2006.00195.xPubMedCrossRef Tume L: The deterioration of children in ward areas in a specialist children's hospital. Nurs Crit Care 2007, 12: 12-19. 10.1111/j.1478-5153.2006.00195.xPubMedCrossRef
19.
go back to reference Smith GB, Prytherch DR, Schmidt PE, Featherstone PI: Review and performance evaluation of aggregate weighted 'track and trigger' systems. Resuscitation 2008, 77: 170-179. 10.1016/j.resuscitation.2007.12.004PubMedCrossRef Smith GB, Prytherch DR, Schmidt PE, Featherstone PI: Review and performance evaluation of aggregate weighted 'track and trigger' systems. Resuscitation 2008, 77: 170-179. 10.1016/j.resuscitation.2007.12.004PubMedCrossRef
20.
go back to reference Smith GB, Prytherch DR, Schmidt PE, Featherstone PI, Higgins B: A review, and performance evaluation, of single-parameter "track and trigger" systems. Resuscitation 2008, 79: 11-21. 10.1016/j.resuscitation.2008.05.004PubMedCrossRef Smith GB, Prytherch DR, Schmidt PE, Featherstone PI, Higgins B: A review, and performance evaluation, of single-parameter "track and trigger" systems. Resuscitation 2008, 79: 11-21. 10.1016/j.resuscitation.2008.05.004PubMedCrossRef
21.
go back to reference Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, Gottesman R, Joffe A, Pfenninger J, Hubert P, Lacroix J, Leclerc F: Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet 2003, 362: 192-197. 10.1016/S0140-6736(03)13908-6PubMedCrossRef Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, Gottesman R, Joffe A, Pfenninger J, Hubert P, Lacroix J, Leclerc F: Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet 2003, 362: 192-197. 10.1016/S0140-6736(03)13908-6PubMedCrossRef
23.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988, 44: 837-845. 10.2307/2531595PubMedCrossRef DeLong ER, DeLong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988, 44: 837-845. 10.2307/2531595PubMedCrossRef
24.
go back to reference Chen J, Hillman K, Bellomo R, Flabouris A, Finfer S, Cretikos M: The impact of introducing medical emergency team system on the documentations of vital signs. Resuscitation 2009, 80: 35-43. 10.1016/j.resuscitation.2008.10.009PubMedCrossRef Chen J, Hillman K, Bellomo R, Flabouris A, Finfer S, Cretikos M: The impact of introducing medical emergency team system on the documentations of vital signs. Resuscitation 2009, 80: 35-43. 10.1016/j.resuscitation.2008.10.009PubMedCrossRef
25.
go back to reference Odetola FO, Rosenberg AL, Davis M, Clark S, Dechert R, Shanley T: Do outcomes vary according to the source of admission to the pediatric intensive care unit. Pediatr Crit Care Med 2008, 9: 20-25. 10.1097/01.PCC.0000298642.11872.29PubMedCrossRef Odetola FO, Rosenberg AL, Davis M, Clark S, Dechert R, Shanley T: Do outcomes vary according to the source of admission to the pediatric intensive care unit. Pediatr Crit Care Med 2008, 9: 20-25. 10.1097/01.PCC.0000298642.11872.29PubMedCrossRef
26.
27.
go back to reference Edwards ED, Powell CV, Mason BW, Oliver A: Prospective cohort study to test the predictability of the Cardiff and Vale paediatric early warning system. Arch Dis Child 2009, 94: 602-606. 10.1136/adc.2008.142026PubMedCrossRef Edwards ED, Powell CV, Mason BW, Oliver A: Prospective cohort study to test the predictability of the Cardiff and Vale paediatric early warning system. Arch Dis Child 2009, 94: 602-606. 10.1136/adc.2008.142026PubMedCrossRef
28.
go back to reference Tucker KM, Brewer TL, Baker RB, Demeritt B, Vossmeyer MT: Prospective evaluation of a pediatric inpatient early warning scoring system. J Spec Pediatr Nurs 2009, 14: 79-85. 10.1111/j.1744-6155.2008.00178.xPubMedCrossRef Tucker KM, Brewer TL, Baker RB, Demeritt B, Vossmeyer MT: Prospective evaluation of a pediatric inpatient early warning scoring system. J Spec Pediatr Nurs 2009, 14: 79-85. 10.1111/j.1744-6155.2008.00178.xPubMedCrossRef
29.
go back to reference Akre M, Finkelstein M, Erickson M, Liu M, Vanderbilt L, Billman G: Sensitivity of the Pediatric Early Warning Score to identify patient deterioration. Pediatrics 2010, 125: e763-e769. 10.1542/peds.2009-0338PubMedCrossRef Akre M, Finkelstein M, Erickson M, Liu M, Vanderbilt L, Billman G: Sensitivity of the Pediatric Early Warning Score to identify patient deterioration. Pediatrics 2010, 125: e763-e769. 10.1542/peds.2009-0338PubMedCrossRef
30.
go back to reference Tibballs J, Kinney S: Reduction of hospital mortality and of preventable cardiac arrest and death on introduction of a pediatric medical emergency team. Pediatr Crit Care Med 2009, 10: 306-312. 10.1097/PCC.0b013e318198b02cPubMedCrossRef Tibballs J, Kinney S: Reduction of hospital mortality and of preventable cardiac arrest and death on introduction of a pediatric medical emergency team. Pediatr Crit Care Med 2009, 10: 306-312. 10.1097/PCC.0b013e318198b02cPubMedCrossRef
31.
go back to reference Hunt EA, Zimmer KP, Rinke ML, Shilkofski NA, Matlin C, Garger C, Dickson C, Miller MR: Transition from a traditional code team to a medical emergency team and categorization of cardiopulmonary arrests in a children's center. Arch Pediatr Adolesc Med 2008, 162: 117-122. 10.1001/archpediatrics.2007.33PubMedCrossRef Hunt EA, Zimmer KP, Rinke ML, Shilkofski NA, Matlin C, Garger C, Dickson C, Miller MR: Transition from a traditional code team to a medical emergency team and categorization of cardiopulmonary arrests in a children's center. Arch Pediatr Adolesc Med 2008, 162: 117-122. 10.1001/archpediatrics.2007.33PubMedCrossRef
32.
go back to reference Pollack MM, Patel KM, Ruttimann UE: PRISM III: an updated Pediatric Risk of Mortality score. Crit Care Med 1996, 24: 743-752. 10.1097/00003246-199605000-00004PubMedCrossRef Pollack MM, Patel KM, Ruttimann UE: PRISM III: an updated Pediatric Risk of Mortality score. Crit Care Med 1996, 24: 743-752. 10.1097/00003246-199605000-00004PubMedCrossRef
33.
go back to reference Slater A, Shann F, Pearson G: PIM2: a revised version of the Paediatric Index of Mortality. Intensive Care Med 2003, 29: 278-285.PubMed Slater A, Shann F, Pearson G: PIM2: a revised version of the Paediatric Index of Mortality. Intensive Care Med 2003, 29: 278-285.PubMed
34.
go back to reference Dryden-Palmer K: Nursing responses to children with evovling critical illness. In MS thesis. University of Victoria, School of Nursing; 2009. Dryden-Palmer K: Nursing responses to children with evovling critical illness. In MS thesis. University of Victoria, School of Nursing; 2009.
35.
go back to reference Wu AW, Folkman S, McPhee SJ, Lo B: Do house officers learn from their mistakes? JAMA 1991, 265: 2089-2094. 10.1001/jama.265.16.2089PubMedCrossRef Wu AW, Folkman S, McPhee SJ, Lo B: Do house officers learn from their mistakes? JAMA 1991, 265: 2089-2094. 10.1001/jama.265.16.2089PubMedCrossRef
36.
go back to reference Cioffi J: Nurses' experiences of making decisions to call emergency assistance to their patients. J Adv Nurs 2000, 32: 108-114. 10.1046/j.1365-2648.2000.01414.xPubMedCrossRef Cioffi J: Nurses' experiences of making decisions to call emergency assistance to their patients. J Adv Nurs 2000, 32: 108-114. 10.1046/j.1365-2648.2000.01414.xPubMedCrossRef
37.
go back to reference Franklin C, Mathew J: Developing strategies to prevent inhospital cardiac arrest: analyzing responses of physicians and nurses in the hours before the event. Crit Care Med 1994, 22: 244-247. 10.1097/00003246-199402000-00014PubMedCrossRef Franklin C, Mathew J: Developing strategies to prevent inhospital cardiac arrest: analyzing responses of physicians and nurses in the hours before the event. Crit Care Med 1994, 22: 244-247. 10.1097/00003246-199402000-00014PubMedCrossRef
38.
go back to reference Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K: A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in Australia and New Zealand, and the United Kingdom: the ACADEMIA study. Resuscitation 2004, 62: 275-282. 10.1016/j.resuscitation.2004.05.016PubMedCrossRef Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K: A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in Australia and New Zealand, and the United Kingdom: the ACADEMIA study. Resuscitation 2004, 62: 275-282. 10.1016/j.resuscitation.2004.05.016PubMedCrossRef
39.
go back to reference Sax FL, Charlson ME: Medical patients at high risk for catastrophic deterioration. Crit Care Med 1987, 15: 510-515. 10.1097/00003246-198705000-00012PubMedCrossRef Sax FL, Charlson ME: Medical patients at high risk for catastrophic deterioration. Crit Care Med 1987, 15: 510-515. 10.1097/00003246-198705000-00012PubMedCrossRef
40.
go back to reference Schein RM, Hazday N, Pena M, Ruben BH, Sprung CL: Clinical antecedents to in-hospital cardiopulmonary arrest. Chest 1990, 98: 1388-1392. 10.1378/chest.98.6.1388PubMedCrossRef Schein RM, Hazday N, Pena M, Ruben BH, Sprung CL: Clinical antecedents to in-hospital cardiopulmonary arrest. Chest 1990, 98: 1388-1392. 10.1378/chest.98.6.1388PubMedCrossRef
Metadata
Title
Multicentre validation of the bedside paediatric early warning system score: a severity of illness score to detect evolving critical illness in hospitalised children
Authors
Christopher S Parshuram
Heather P Duncan
Ari R Joffe
Catherine A Farrell
Jacques R Lacroix
Kristen L Middaugh
James S Hutchison
David Wensley
Nadeene Blanchard
Joseph Beyene
Patricia C Parkin
Publication date
01-08-2011
Publisher
BioMed Central
Published in
Critical Care / Issue 4/2011
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc10337

Other articles of this Issue 4/2011

Critical Care 4/2011 Go to the issue