Top

Intensive Care Medicine

Published in:

01-05-2010 | Brief Report

The interrater reliability of SAPS II and SAPS 3

Authors: K. Strand, L. I. Strand, H. Flaatten

Published in: Intensive Care Medicine | Issue 5/2010

Abstract

Purpose

In this study we evaluated and compared the interrater reliability of SAPS II and SAPS 3 in order to measure the consistency of performance among different raters.

Method

Ten junior doctors working at two general ICUs were trained in the use of SAPS II and SAPS 3 using a 2.5-h training program. After training they scored 24 cases in both systems. Scores were analyzed using intraclass correlation coefficient (ICC) statistics. In order to identify variables with low reliability, subscores were analyzed using the ICC, and single-variables were compared to a template score using weighted kappa statistics.

Results

The ICC (95% CI) of the scores was 0.84 (0.74, 0.91) in SAPS II and 0.80 (0.68, 0.89) in SAPS 3, which is considered adequate for both systems. Mean mortality predictions among the raters had a range of 0.12 in SAPS II and 0.19 in SAPS 3. Administrative data including age had high reliability, whereas variables based on diagnostic information had only moderate reliability. Laboratory data had consistently higher reliability than variables based on the interpretation of charts.

Conclusion

Both SAPS II and SAPS 3 have adequate interrater reliability, but the standardized mortality ratios are still likely to be influenced by the rater's scoring practice.

http://faculty.vassar.edu/lowry/VassarStats.html accessed in June 2009.

Le Gall JR, Lemeshow S, Saulnier F (1993) A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study. JAMA 270:2957–2963CrossRefPubMed

Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR, SAPS 3 Investigators (2005) SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31:1345–1355CrossRefPubMed

Strand K, Søreide E, Aardal S, Flaatten H (2009) A comparison of SAPS II and SAPS 3 in a Norwegian intensive care unit population. Acta Anaesthesiol Scand 53:595–600CrossRefPubMed

Metnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR, SAPS 3 Investigators (2005) SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 1: objectives, methods and cohort description. Intensive Care Med 31:1336–1344CrossRefPubMed

Capuzzo M, Valpondi V, Sgarbi A, Bortolazzi S, Pavoni V, Gilli G, Candini G, Gritti G, Alvisi R (1998) Reliability of the general severity scoring systems, APACHE II and SAPS II. Clin Intensive Care 9:4–10CrossRef

Polderman KG, Jorna EM, Girbes AR (2001) Inter-observer variability in APACHE II scoring: effect of strict guidelines and training. Intensive Care Med 27:1365–1369CrossRefPubMed

Kho ME, McDonald E, Stratford PW, Cook DJ (2007) Interrater reliability of APACHE II scores for medical-surgical intensive care patients: a prospective blinded study. Am J Crit Care 16:378–383PubMed

Chen LM, Martin CM, Morrison TL, Sibbald WJ (1999) Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. Crit Care Med 27:1999–2004CrossRefPubMed

Wenner JB, Norena M, Khan N, Palepu A, Ayas NT, Wong H, Dodek PM (2009) Reliability of intensive care unit admitting and comorbid diagnoses, race, elements of acute physiology and chronic health evaluation II score, and predicted probability of mortality in an electronic intensive care unit database. J Crit Care 24:401–407CrossRefPubMed

10.

Walter SD, Eliasziw M, Donner A (1998) Sample size and optimal designs for reliability studies. Stat Med 17:101–110CrossRefPubMed

11.

Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428CrossRefPubMed

12.

Altman D (1991) Practical statistics for medical research. Chapman & Hall, London

13.

Sim J, Wright CC (2005) The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther 85:257–268PubMed

14.

Suistomaa M, Kari A, Ruokonen E, Takala J (2000) Sampling rate causes bias in APACHE II and SAPS II scores. Intensive Care Med 26:1773–1778CrossRefPubMed

Title: The interrater reliability of SAPS II and SAPS 3
Authors: K. Strand
L. I. Strand
H. Flaatten
Publication date: 01-05-2010
Publisher: Springer-Verlag
Published in: Intensive Care Medicine / Issue 5/2010
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI: https://doi.org/10.1007/s00134-010-1772-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

The interrater reliability of SAPS II and SAPS 3

Abstract

Purpose

Method

Results

Conclusion

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Purpose

Method

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 5/2010

Individual patient data meta-analysis in intensive care medicine and contextual effects

Hypercytokinemia with 2009 pandemic H1N1 (pH1N1) influenza successfully treated with polymyxin B-immobilized fiber column hemoperfusion

Reply to Agrafiotis

Microbiogical data, but not procalcitonin improve the accuracy of the clinical pulmonary infection score

Reply to Hurley

Lipid emulsions in parenteral nutrition of intensive care patients: current thinking and future directions