Skip to main content
Top
Published in: Critical Care 2/2010

Open Access 01-04-2010 | Research

Inter-rater reliability of the Full Outline of UnResponsiveness score and the Glasgow Coma Scale in critically ill patients: a prospective observational study

Authors: Michael Fischer, Stephan Rüegg, Adam Czaplinski, Monika Strohmeier, Angelika Lehmann, Franziska Tschan, Patrick R Hunziker, Stephan C Marsch

Published in: Critical Care | Issue 2/2010

Login to get access

Abstract

Introduction

The Glasgow Coma Scale (GCS) is the most widely used scoring system for comatose patients in intensive care. Limitations of the GCS include the impossibility to assess the verbal score in intubated or aphasic patients, and an inconsistent inter-rater reliability. The FOUR (Full Outline of UnResponsiveness) score, a new coma scale not reliant on verbal response, was recently proposed. The aim of the present study was to compare the inter-rater reliability of the GCS and the FOUR score among unselected patients in general critical care. A further aim was to compare the inter-rater reliability of neurologists with that of intensive care unit (ICU) staff.

Methods

In this prospective observational study, scoring of GCS and FOUR score was performed by neurologists and ICU staff on 267 consecutive patients admitted to intensive care.

Results

In a total of 437 pair wise ratings the exact inter-rater agreement for the GCS was 71%, and for the FOUR score 82% (P = 0.0016); the inter-rater agreement within a range of ± 1 score point for the GCS was 90%, and for the FOUR score 92% (P = ns.). The exact inter-rater agreement among neurologists was superior to that among ICU staff for the FOUR score (87% vs. 79%, P = 0.04) but not for the GCS (73% vs. 73%). Neurologists and ICU staff did not significantly differ in the inter-rater agreement within a range of ± 1 score point for both GCS (88% vs. 93%) and the FOUR score (91% vs. 88%).

Conclusions

The FOUR score performed better than the GCS for exact inter-rater agreement, but not for the clinically more relevant agreement within the range of ± 1 score point. Though neurologists outperformed ICU staff with regard to exact inter-rater agreement, the inter-rater agreement of ICU staff within the clinically more relevant range of ± 1 score point equalled that of the neurologists. The small advantage in inter-rater reliability of the FOUR score is most likely insufficient to replace the GCS, a score with a long tradition in intensive care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Teasdale G, Jennett B: Assessment of coma and impaired consciousness. A practical scale. Lancet 1974, 2: 81-84. 10.1016/S0140-6736(74)91639-0CrossRefPubMed Teasdale G, Jennett B: Assessment of coma and impaired consciousness. A practical scale. Lancet 1974, 2: 81-84. 10.1016/S0140-6736(74)91639-0CrossRefPubMed
2.
go back to reference Gill M, Martens K, Lynch EL, Salih A, Green SM: Interrater reliability of 3 simplified neurologic scales applied to adults presenting to the emergency department with altered levels of consciousness. Ann Emerg Med 2007, 49: 403-407. 10.1016/j.annemergmed.2006.03.031CrossRefPubMed Gill M, Martens K, Lynch EL, Salih A, Green SM: Interrater reliability of 3 simplified neurologic scales applied to adults presenting to the emergency department with altered levels of consciousness. Ann Emerg Med 2007, 49: 403-407. 10.1016/j.annemergmed.2006.03.031CrossRefPubMed
3.
go back to reference Balestreri M, Czosnyka M, Chatfield DA, Steiner LA, Schmidt EA, Smielewski P, Matta B, Pickard JD: Predictive value of Glasgow Coma Scale after brain trauma: change in trend over the past ten years. J Neurol Neurosurg Psychiatry 2004, 75: 161-162.PubMedCentralPubMed Balestreri M, Czosnyka M, Chatfield DA, Steiner LA, Schmidt EA, Smielewski P, Matta B, Pickard JD: Predictive value of Glasgow Coma Scale after brain trauma: change in trend over the past ten years. J Neurol Neurosurg Psychiatry 2004, 75: 161-162.PubMedCentralPubMed
4.
go back to reference Benzer A, Mitterschiffthaler G, Marosi M, Luef G, Puhringer F, De La Renotiere K, Lehner H, Schmutzhard E: Prediction of non-survival after trauma: Innsbruck Coma Scale. Lancet 1991, 338: 977-978. 10.1016/0140-6736(91)91840-QCrossRefPubMed Benzer A, Mitterschiffthaler G, Marosi M, Luef G, Puhringer F, De La Renotiere K, Lehner H, Schmutzhard E: Prediction of non-survival after trauma: Innsbruck Coma Scale. Lancet 1991, 338: 977-978. 10.1016/0140-6736(91)91840-QCrossRefPubMed
5.
go back to reference Gill M, Windemuth R, Steele R, Green SM: A comparison of the Glasgow Coma Scale score to simplified alternative scores for the prediction of traumatic brain injury outcomes. Ann Emerg Med 2005, 45: 37-42. 10.1016/j.annemergmed.2004.07.429CrossRefPubMed Gill M, Windemuth R, Steele R, Green SM: A comparison of the Glasgow Coma Scale score to simplified alternative scores for the prediction of traumatic brain injury outcomes. Ann Emerg Med 2005, 45: 37-42. 10.1016/j.annemergmed.2004.07.429CrossRefPubMed
6.
go back to reference Stanczak DE, White JG III, Gouview WD, Moehle KA, Daniel M, Novack T, Long CJ: Assessment of level of consciousness following severe neurological insult. A comparison of the psychometric qualities of the Glasgow Coma Scale and the Comprehensive Level of Consciousness Scale. J Neurosurg 1984, 60: 955-960. 10.3171/jns.1984.60.5.0955CrossRefPubMed Stanczak DE, White JG III, Gouview WD, Moehle KA, Daniel M, Novack T, Long CJ: Assessment of level of consciousness following severe neurological insult. A comparison of the psychometric qualities of the Glasgow Coma Scale and the Comprehensive Level of Consciousness Scale. J Neurosurg 1984, 60: 955-960. 10.3171/jns.1984.60.5.0955CrossRefPubMed
7.
go back to reference Starmark JE, Stalhammar D, Holmgren E, Rosander B: A comparison of the Glasgow Coma Scale and the Reaction Level Scale (RLS85). J Neurosurg 1988, 69: 699-706. 10.3171/jns.1988.69.5.0699CrossRefPubMed Starmark JE, Stalhammar D, Holmgren E, Rosander B: A comparison of the Glasgow Coma Scale and the Reaction Level Scale (RLS85). J Neurosurg 1988, 69: 699-706. 10.3171/jns.1988.69.5.0699CrossRefPubMed
8.
go back to reference Wijdicks EF, Bamlet WR, Maramattom BV, Manno EM, McClelland RL: Validation of a new coma scale: The FOUR score. Ann Neurol 2005, 58: 585-593. 10.1002/ana.20611CrossRefPubMed Wijdicks EF, Bamlet WR, Maramattom BV, Manno EM, McClelland RL: Validation of a new coma scale: The FOUR score. Ann Neurol 2005, 58: 585-593. 10.1002/ana.20611CrossRefPubMed
9.
go back to reference Wolf CA, Wijdicks EF, Bamlet WR, McClelland RL: Further Validation of the FOUR score coma scale by intensive care nurses. Mayo Clinic Proceedings 2007, 82: 435-438. 10.4065/82.4.435CrossRefPubMed Wolf CA, Wijdicks EF, Bamlet WR, McClelland RL: Further Validation of the FOUR score coma scale by intensive care nurses. Mayo Clinic Proceedings 2007, 82: 435-438. 10.4065/82.4.435CrossRefPubMed
10.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977, 33: 159-174. 10.2307/2529310CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977, 33: 159-174. 10.2307/2529310CrossRefPubMed
11.
go back to reference Eken C, Kartal M, Bacanli A, Eray O: Comparison of the Full Outline of Unresponsiveness Score Coma Scale and the Glasgow Coma Scale in an emergency setting population. Eur J Emerg Med 2009, 16: 29-36.CrossRefPubMed Eken C, Kartal M, Bacanli A, Eray O: Comparison of the Full Outline of Unresponsiveness Score Coma Scale and the Glasgow Coma Scale in an emergency setting population. Eur J Emerg Med 2009, 16: 29-36.CrossRefPubMed
13.
go back to reference Iyer VN, Mandrekar JN, Danielson RD, Zubkov AY, Elmer JL, Wijdicks EF: Validity of the FOUR score coma scale in the medical intensive care unit. Mayo Clin Proc 2009, 84: 694-701. 10.4065/84.8.694PubMedCentralCrossRefPubMed Iyer VN, Mandrekar JN, Danielson RD, Zubkov AY, Elmer JL, Wijdicks EF: Validity of the FOUR score coma scale in the medical intensive care unit. Mayo Clin Proc 2009, 84: 694-701. 10.4065/84.8.694PubMedCentralCrossRefPubMed
14.
go back to reference Ely EW, Truman B, Shintani A, Thomason JW, Wheeler AP, Gordon S, Francis J, Speroff T, Gautam S, Margolin R, Sessler CN, Dittus RS, Bernard GR: Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Agitation-Sedation Scale (RASS). JAMA 2003, 289: 2983-2991. 10.1001/jama.289.22.2983CrossRefPubMed Ely EW, Truman B, Shintani A, Thomason JW, Wheeler AP, Gordon S, Francis J, Speroff T, Gautam S, Margolin R, Sessler CN, Dittus RS, Bernard GR: Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Agitation-Sedation Scale (RASS). JAMA 2003, 289: 2983-2991. 10.1001/jama.289.22.2983CrossRefPubMed
15.
go back to reference Kho ME, McDonald E, Stratford PW, Cook DJ: Interrater reliability of APACHE II scores for medical-surgical intensive care patients: a prospective blinded study. Am J Crit Care 2007, 16: 378-383.PubMed Kho ME, McDonald E, Stratford PW, Cook DJ: Interrater reliability of APACHE II scores for medical-surgical intensive care patients: a prospective blinded study. Am J Crit Care 2007, 16: 378-383.PubMed
16.
go back to reference Murray GD, Butcher I, McHugh GS, Lu J, Mushkudiani NA, Maas AI, Marmarou A, Steyerberg EW: Multivariable prognostic analysis in traumatic brain injury: results from the IMPACT study. J Neurotrauma 2007, 24: 329-337. 10.1089/neu.2006.0035CrossRefPubMed Murray GD, Butcher I, McHugh GS, Lu J, Mushkudiani NA, Maas AI, Marmarou A, Steyerberg EW: Multivariable prognostic analysis in traumatic brain injury: results from the IMPACT study. J Neurotrauma 2007, 24: 329-337. 10.1089/neu.2006.0035CrossRefPubMed
Metadata
Title
Inter-rater reliability of the Full Outline of UnResponsiveness score and the Glasgow Coma Scale in critically ill patients: a prospective observational study
Authors
Michael Fischer
Stephan Rüegg
Adam Czaplinski
Monika Strohmeier
Angelika Lehmann
Franziska Tschan
Patrick R Hunziker
Stephan C Marsch
Publication date
01-04-2010
Publisher
BioMed Central
Published in
Critical Care / Issue 2/2010
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc8963

Other articles of this Issue 2/2010

Critical Care 2/2010 Go to the issue