Skip to main content
Top
Published in: Critical Care 1/2018

Open Access 01-12-2018 | Research

Validation of the SOS-PD scale for assessment of pediatric delirium: a multicenter study

Authors: Erwin Ista, Babette van Beusekom, Joost van Rosmalen, Martin C. J. Kneyber, Joris Lemson, Arno Brouwers, Gwen C. Dieleman, Bram Dierckx, Matthijs de Hoog, Dick Tibboel, Monique van Dijk

Published in: Critical Care | Issue 1/2018

Login to get access

Abstract

Backgrounds

Reports of increasing incidence rates of delirium in critically ill children are reason for concern. We evaluated the measurement properties of the pediatric delirium component (PD-scale) of the Sophia Observation Withdrawal Symptoms scale Pediatric Delirium scale (SOS-PD scale).

Methods

In a multicenter prospective observational study in four Dutch pediatric ICUs (PICUs), patients aged ≥ 3 months and admitted for ≥ 48 h were assessed with the PD-scale thrice daily. Criterion validity was assessed: if the PD-scale score was ≥ 4, a child psychiatrist clinically assessed the presence or absence of PD according to the Diagnostic and statistical manual of mental disorders (DSM)-IV. In addition, the child psychiatrist assessed a randomly selected group to establish the false-negative rate. The construct validity was assessed by calculating the Pearson coefficient (rp) for correlation between the PD-scale and Cornell Assessment Pediatric Delirium (CAP-D) scores. Interrater reliability was determined by comparing paired nurse-researcher PD-scale assessments and calculating the intraclass correlation coefficient (ICC).

Results

Four hundred eighty-five patients with a median age of 27.0 months (IQR 8–102) were included, of whom 48 patients were diagnosed with delirium by the child psychiatrist. The PD-scale had overall sensitivity of 92.3% and specificity of 96.5% compared to the psychiatrist diagnosis for a cutoff score ≥4 points. The rp between the PD-scale and the CAP-D was 0.89 (CI 95%, 0.82–0.93; p < 0.001). The ICC of 75 paired nurse-researcher observations was 0.99 (95% CI, 0.98–0.99).

Conclusions

The PD-scale has good reliability and validity for early screening of PD in critically ill children. It can be validly and reliably used by nurses to this aim.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ely EW, Gautam S, Margolin R, Francis J, May L, Speroff T, Truman B, Dittus R, Bernard R, Inouye SK. The impact of delirium in the intensive care unit on hospital length of stay. Intensive Care Med. 2001;27(12):1892–900.CrossRef Ely EW, Gautam S, Margolin R, Francis J, May L, Speroff T, Truman B, Dittus R, Bernard R, Inouye SK. The impact of delirium in the intensive care unit on hospital length of stay. Intensive Care Med. 2001;27(12):1892–900.CrossRef
2.
go back to reference Ouimet S, Kavanagh BP, Gottfried SB, Skrobik Y. Incidence, risk factors and consequences of ICU delirium. Intensive Care Med. 2007;33(1):66–73.CrossRef Ouimet S, Kavanagh BP, Gottfried SB, Skrobik Y. Incidence, risk factors and consequences of ICU delirium. Intensive Care Med. 2007;33(1):66–73.CrossRef
3.
go back to reference van den Boogaard M, Schoonhoven L, van der Hoeven JG, van Achterberg T, Pickkers P. Incidence and short-term consequences of delirium in critically ill patients: a prospective observational cohort study. Int J Nurs Stud. 2012;49(7):775–83.CrossRef van den Boogaard M, Schoonhoven L, van der Hoeven JG, van Achterberg T, Pickkers P. Incidence and short-term consequences of delirium in critically ill patients: a prospective observational cohort study. Int J Nurs Stud. 2012;49(7):775–83.CrossRef
4.
go back to reference Janssen NJ, Tan EY, Staal M, Janssen EP, Leroy PL, Lousberg R, van Os J, Schieveld JN. On the utility of diagnostic instruments for pediatric delirium in critical illness: an evaluation of the Pediatric Anesthesia Emergence Delirium Scale, the Delirium Rating Scale 88, and the Delirium Rating Scale-Revised R-98. Intensive Care Med. 2011;37(8):1331–7.CrossRef Janssen NJ, Tan EY, Staal M, Janssen EP, Leroy PL, Lousberg R, van Os J, Schieveld JN. On the utility of diagnostic instruments for pediatric delirium in critical illness: an evaluation of the Pediatric Anesthesia Emergence Delirium Scale, the Delirium Rating Scale 88, and the Delirium Rating Scale-Revised R-98. Intensive Care Med. 2011;37(8):1331–7.CrossRef
5.
go back to reference Larsen GY, Donaldson AE, Parker HB, Grant MJ. Preventable harm occurring to critically ill children. Pediatr Crit Care Med. 2007;8(4):331–6.PubMed Larsen GY, Donaldson AE, Parker HB, Grant MJ. Preventable harm occurring to critically ill children. Pediatr Crit Care Med. 2007;8(4):331–6.PubMed
6.
go back to reference Schieveld JN, Leroy PL, van Os J, Nicolai J, Vos GD, Leentjens AF. Pediatric delirium in critical illness: phenomenology, clinical correlates and treatment response in 40 cases in the pediatric intensive care unit. Intensive Care Med. 2007;33(6):1033–40.CrossRef Schieveld JN, Leroy PL, van Os J, Nicolai J, Vos GD, Leentjens AF. Pediatric delirium in critical illness: phenomenology, clinical correlates and treatment response in 40 cases in the pediatric intensive care unit. Intensive Care Med. 2007;33(6):1033–40.CrossRef
7.
go back to reference Silver G, Traube C, Kearney J, Kelly D, Yoon MJ, Moyal WN, Gangopadhyay M, Shao HB, Ward MJ. Detecting pediatric delirium: development of a rapid observational assessment tool. Intens Care Med. 2012;38(6):1025–31.CrossRef Silver G, Traube C, Kearney J, Kelly D, Yoon MJ, Moyal WN, Gangopadhyay M, Shao HB, Ward MJ. Detecting pediatric delirium: development of a rapid observational assessment tool. Intens Care Med. 2012;38(6):1025–31.CrossRef
8.
go back to reference Smith HA, Boyd J, Fuchs DC, Melvin K, Berry P, Shintani A, Eden SK, Terrell MK, Boswell T, Wolfram K, et al. Diagnosing delirium in critically ill children: validity and reliability of the Pediatric Confusion Assessment Method for the intensive care unit. Crit Care Med. 2011;39(1):150–7.CrossRef Smith HA, Boyd J, Fuchs DC, Melvin K, Berry P, Shintani A, Eden SK, Terrell MK, Boswell T, Wolfram K, et al. Diagnosing delirium in critically ill children: validity and reliability of the Pediatric Confusion Assessment Method for the intensive care unit. Crit Care Med. 2011;39(1):150–7.CrossRef
9.
go back to reference Smith HA, Gangopadhyay M, Goben CM, Jacobowski NL, Chestnut MH, Savage S, Rutherford MT, Denton D, Thompson JL, Chandrasekhar R, et al. The Preschool Confusion Assessment Method for the ICU: valid and reliable delirium monitoring for critically ill infants and children. Crit Care Med. 2016;44(3):592–600.CrossRef Smith HA, Gangopadhyay M, Goben CM, Jacobowski NL, Chestnut MH, Savage S, Rutherford MT, Denton D, Thompson JL, Chandrasekhar R, et al. The Preschool Confusion Assessment Method for the ICU: valid and reliable delirium monitoring for critically ill infants and children. Crit Care Med. 2016;44(3):592–600.CrossRef
10.
go back to reference Traube C, Silver G, Kearney J, Patel A, Atkinson TM, Yoon MJ, Halpert S, Augenstein J, Sickles LE, Li C, et al. Cornell Assessment of Pediatric Delirium: a valid, rapid, observational tool for screening delirium in the PICU. Crit Care Med. 2014;42(3):656–63.CrossRef Traube C, Silver G, Kearney J, Patel A, Atkinson TM, Yoon MJ, Halpert S, Augenstein J, Sickles LE, Li C, et al. Cornell Assessment of Pediatric Delirium: a valid, rapid, observational tool for screening delirium in the PICU. Crit Care Med. 2014;42(3):656–63.CrossRef
11.
go back to reference American Psychiatric Association. Diagnostic and statistical manual of mental disorders, DSM-IV-TR. Washington, DC: American Psychiatric Association; 2000. American Psychiatric Association. Diagnostic and statistical manual of mental disorders, DSM-IV-TR. Washington, DC: American Psychiatric Association; 2000.
12.
go back to reference Pandharipande PP, Girard TD, Jackson JC, Morandi A, Thompson JL, Pun BT, Brummel NE, Hughes CG, Vasilevskis EE, Shintani AK, et al. Long-term cognitive impairment after critical illness. N Engl J Med. 2013;369(14):1306–16.CrossRef Pandharipande PP, Girard TD, Jackson JC, Morandi A, Thompson JL, Pun BT, Brummel NE, Hughes CG, Vasilevskis EE, Shintani AK, et al. Long-term cognitive impairment after critical illness. N Engl J Med. 2013;369(14):1306–16.CrossRef
13.
go back to reference Mehta S, Cook D, Devlin JW, Skrobik Y, Meade M, Fergusson D, Herridge M, Steinberg M, Granton J, Ferguson N, et al. Prevalence, risk factors, and outcomes of delirium in mechanically ventilated adults. Crit Care Med. 2015;43(3):557–66.CrossRef Mehta S, Cook D, Devlin JW, Skrobik Y, Meade M, Fergusson D, Herridge M, Steinberg M, Granton J, Ferguson N, et al. Prevalence, risk factors, and outcomes of delirium in mechanically ventilated adults. Crit Care Med. 2015;43(3):557–66.CrossRef
14.
go back to reference Silver G, Traube C, Gerber LM, Sun XM, Kearney J, Patel A, Greenwald B. Pediatric Delirium and Associated Risk Factors: a single-center prospective observational study. Pediatr Crit Care Me. 2015;16(4):303–9.CrossRef Silver G, Traube C, Gerber LM, Sun XM, Kearney J, Patel A, Greenwald B. Pediatric Delirium and Associated Risk Factors: a single-center prospective observational study. Pediatr Crit Care Me. 2015;16(4):303–9.CrossRef
15.
go back to reference Smeets IA, Tan EY, Vossen HG, Leroy PL, Lousberg RH, van Os J, Schieveld JN. Prolonged stay at the paediatric intensive care unit associated with paediatric delirium. Eur Child Adolesc Psychiatry. 2010;19(4):389–93.CrossRef Smeets IA, Tan EY, Vossen HG, Leroy PL, Lousberg RH, van Os J, Schieveld JN. Prolonged stay at the paediatric intensive care unit associated with paediatric delirium. Eur Child Adolesc Psychiatry. 2010;19(4):389–93.CrossRef
16.
go back to reference Traube C, Mauer EA, Gerber LM, Kaur S, Joyce C, Kerson A, Carlo C, Notterman D, Worgall S, Silver G, et al. Cost associated with pediatric delirium in the ICU. Crit Care Med. 2016;44(12):e1175–9.CrossRef Traube C, Mauer EA, Gerber LM, Kaur S, Joyce C, Kerson A, Carlo C, Notterman D, Worgall S, Silver G, et al. Cost associated with pediatric delirium in the ICU. Crit Care Med. 2016;44(12):e1175–9.CrossRef
17.
go back to reference Ista E, van Dijk M, de Hoog M, Tibboel D, Duivenvoorden HJ. Construction of the Sophia Observation withdrawal Symptoms-scale (SOS) for critically ill children. Intensive Care Med. 2009;35(6):1075–81.CrossRef Ista E, van Dijk M, de Hoog M, Tibboel D, Duivenvoorden HJ. Construction of the Sophia Observation withdrawal Symptoms-scale (SOS) for critically ill children. Intensive Care Med. 2009;35(6):1075–81.CrossRef
18.
go back to reference Ista E, de Hoog M, Tibboel D, Duivenvoorden HJ, van Dijk M. Psychometric evaluation of the Sophia Observation Withdrawal Symptoms Scale in critically ill children. Pediatr Crit Care Med. 2013;14(8):761–9.CrossRef Ista E, de Hoog M, Tibboel D, Duivenvoorden HJ, van Dijk M. Psychometric evaluation of the Sophia Observation Withdrawal Symptoms Scale in critically ill children. Pediatr Crit Care Med. 2013;14(8):761–9.CrossRef
19.
go back to reference van Dijk M, Knoester H, van Beusekom BS, Ista E. Screening pediatric delirium with an adapted version of the Sophia Observation Withdrawal Symptoms scale (SOS). Intensive Care Med. 2012;38(3):531–2.CrossRef van Dijk M, Knoester H, van Beusekom BS, Ista E. Screening pediatric delirium with an adapted version of the Sophia Observation Withdrawal Symptoms scale (SOS). Intensive Care Med. 2012;38(3):531–2.CrossRef
20.
go back to reference Madden K, Burns MM, Tasker RC. Differentiating delirium from sedative/hypnotic-related iatrogenic withdrawal syndrome: lack of specificity in pediatric critical care assessment tools. Pediatr Crit Care Med. 2017;18(6):580–8.CrossRef Madden K, Burns MM, Tasker RC. Differentiating delirium from sedative/hypnotic-related iatrogenic withdrawal syndrome: lack of specificity in pediatric critical care assessment tools. Pediatr Crit Care Med. 2017;18(6):580–8.CrossRef
21.
go back to reference Ista E, Te Beest H, van Rosmalen J, de Hoog M, Tibboel D, van Beusekom B, van Dijk M. Sophia Observation Withdrawal Symptoms-Paediatric Delirium scale: a tool for early screening of delirium in the PICU. Aust Crit Care. 2018;31(5):266–73.CrossRef Ista E, Te Beest H, van Rosmalen J, de Hoog M, Tibboel D, van Beusekom B, van Dijk M. Sophia Observation Withdrawal Symptoms-Paediatric Delirium scale: a tool for early screening of delirium in the PICU. Aust Crit Care. 2018;31(5):266–73.CrossRef
22.
go back to reference Ista E, van Dijk M, Tibboel D, de Hoog M. Assessment of sedation levels in pediatric intensive care patients can be improved by using the COMFORT “behavior” scale. Pediatr Crit Care Med. 2005;6(1):58–63.CrossRef Ista E, van Dijk M, Tibboel D, de Hoog M. Assessment of sedation levels in pediatric intensive care patients can be improved by using the COMFORT “behavior” scale. Pediatr Crit Care Med. 2005;6(1):58–63.CrossRef
23.
go back to reference Kerson AG, DeMaria R, Mauer E, Joyce C, Gerber LM, Greenwald BM, Silver G, Traube C. Validity of the Richmond Agitation-Sedation Scale (RASS) in critically ill children. J Intensive Care. 2016;4:65.CrossRef Kerson AG, DeMaria R, Mauer E, Joyce C, Gerber LM, Greenwald BM, Silver G, Traube C. Validity of the Richmond Agitation-Sedation Scale (RASS) in critically ill children. J Intensive Care. 2016;4:65.CrossRef
24.
go back to reference Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8.CrossRef Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8.CrossRef
25.
go back to reference Fleiss JL. Statistical methods for rates and proportions. New York: Wiley; 1981. Fleiss JL. Statistical methods for rates and proportions. New York: Wiley; 1981.
26.
go back to reference Begg CB, Greenes RA. Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics. 1983;39(1):207–15.CrossRef Begg CB, Greenes RA. Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics. 1983;39(1):207–15.CrossRef
27.
go back to reference Zhou XH. A nonparametric maximum likelihood estimator for the receiver operating characteristic curve area in the presence of verification bias. Biometrics. 1996;52(1):299–305.CrossRef Zhou XH. A nonparametric maximum likelihood estimator for the receiver operating characteristic curve area in the presence of verification bias. Biometrics. 1996;52(1):299–305.CrossRef
28.
go back to reference Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, Bouter LM, de Vet HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.CrossRef Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, Bouter LM, de Vet HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.CrossRef
29.
go back to reference Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.CrossRef Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.CrossRef
30.
go back to reference Deeks JJ, Altman DG. Diagnostic tests 4: likelihood ratios. BMJ. 2004;329(7458):168–9.CrossRef Deeks JJ, Altman DG. Diagnostic tests 4: likelihood ratios. BMJ. 2004;329(7458):168–9.CrossRef
31.
go back to reference Daoud A, Duff JP, Joffe AR, Alberta Sepsis N. Diagnostic accuracy of delirium diagnosis in pediatric intensive care: a systematic review. Crit Care. 2014;18(5):489.CrossRef Daoud A, Duff JP, Joffe AR, Alberta Sepsis N. Diagnostic accuracy of delirium diagnosis in pediatric intensive care: a systematic review. Crit Care. 2014;18(5):489.CrossRef
32.
go back to reference Schieveld JN, van Zwieten JJ. From pediatrics to geriatrics: toward a unified standardized screening tool for delirium: a thought experiment. Crit Care Med. 2016;44(9):1778–80.CrossRef Schieveld JN, van Zwieten JJ. From pediatrics to geriatrics: toward a unified standardized screening tool for delirium: a thought experiment. Crit Care Med. 2016;44(9):1778–80.CrossRef
33.
go back to reference Smith HA, Han JH, Ely EW. Meeting the challenges of delirium assessment across the aging spectrum. Crit Care Med. 2016;44(9):1775–7.CrossRef Smith HA, Han JH, Ely EW. Meeting the challenges of delirium assessment across the aging spectrum. Crit Care Med. 2016;44(9):1775–7.CrossRef
34.
go back to reference Kudchadkar SR, Yaster M, Punjabi NM. Sedation, sleep promotion, and delirium screening practices in the care of mechanically ventilated children: a wake-up call for the pediatric critical care community. Crit Care Med. 2014;42(7):1592–600.CrossRef Kudchadkar SR, Yaster M, Punjabi NM. Sedation, sleep promotion, and delirium screening practices in the care of mechanically ventilated children: a wake-up call for the pediatric critical care community. Crit Care Med. 2014;42(7):1592–600.CrossRef
35.
go back to reference Barr J, Fraser GL, Puntillo K, Ely EW, Gelinas C, Dasta JF, Davidson JE, Devlin JW, Kress JP, Joffe AM, et al. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med. 2013;41(1):263–306.CrossRef Barr J, Fraser GL, Puntillo K, Ely EW, Gelinas C, Dasta JF, Davidson JE, Devlin JW, Kress JP, Joffe AM, et al. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med. 2013;41(1):263–306.CrossRef
36.
go back to reference Bledowski J, Trutia A. A review of pharmacologic management and prevention strategies for delirium in the intensive care unit. Psychosomatics. 2012;53(3):203–11.CrossRef Bledowski J, Trutia A. A review of pharmacologic management and prevention strategies for delirium in the intensive care unit. Psychosomatics. 2012;53(3):203–11.CrossRef
37.
go back to reference Schieveld JN, de Graeff-Meeder ER, Kalverdijk LJ, Gerver JAM, Knoester H, de Neef M, Ista E, de Hoog M, Koomen E, Catsman-Berrevoets CE, et al. Dutch multidiciplinary guideline for pediatric delirium. Utrecht: Dutch Psychiatric Association (Nederlands Vereniging voor Psychiatric - NVvP; 2014. Schieveld JN, de Graeff-Meeder ER, Kalverdijk LJ, Gerver JAM, Knoester H, de Neef M, Ista E, de Hoog M, Koomen E, Catsman-Berrevoets CE, et al. Dutch multidiciplinary guideline for pediatric delirium. Utrecht: Dutch Psychiatric Association (Nederlands Vereniging voor Psychiatric - NVvP; 2014.
38.
go back to reference Simone S, Edwards S, Lardieri A, Walker LK, Graciano AL, Kishk OA, Custer JW. Implementation of an ICU bundle: an interprofessional quality improvement project to enhance delirium management and monitor delirium prevalence in a single PICU. Pediatr Crit Care Med. 2017;18(6):531–40.CrossRef Simone S, Edwards S, Lardieri A, Walker LK, Graciano AL, Kishk OA, Custer JW. Implementation of an ICU bundle: an interprofessional quality improvement project to enhance delirium management and monitor delirium prevalence in a single PICU. Pediatr Crit Care Med. 2017;18(6):531–40.CrossRef
39.
go back to reference Traube C, Silver G, Gerber LM, Kaur S, Mauer EA, Kerson A, Joyce C, Greenwald BM. Delirium and mortality in critically ill children: epidemiology and outcomes of pediatric delirium. Crit Care Med. 2017;45(5):891–8.CrossRef Traube C, Silver G, Gerber LM, Kaur S, Mauer EA, Kerson A, Joyce C, Greenwald BM. Delirium and mortality in critically ill children: epidemiology and outcomes of pediatric delirium. Crit Care Med. 2017;45(5):891–8.CrossRef
Metadata
Title
Validation of the SOS-PD scale for assessment of pediatric delirium: a multicenter study
Authors
Erwin Ista
Babette van Beusekom
Joost van Rosmalen
Martin C. J. Kneyber
Joris Lemson
Arno Brouwers
Gwen C. Dieleman
Bram Dierckx
Matthijs de Hoog
Dick Tibboel
Monique van Dijk
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Critical Care / Issue 1/2018
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/s13054-018-2238-z

Other articles of this Issue 1/2018

Critical Care 1/2018 Go to the issue