Skip to main content
Top
Published in: BMC Anesthesiology 1/2020

01-12-2020 | Care | Research article

Assignment of pre-event ASA physical status classification by pre-hospital physicians: a prospective inter-rater reliability study

Authors: Kristin Tønsager, Marius Rehn, Andreas J. Krüger, Jo Røislien, Kjetil G. Ringdal

Published in: BMC Anesthesiology | Issue 1/2020

Login to get access

Abstract

Background

Individualized treatment is a common principle in hospitals. Treatment decisions are made based on the patient’s condition, including comorbidities. This principle is equally relevant out-of-hospital. Furthermore, comorbidity is an important risk-adjustment factor when evaluating pre-hospital interventions and may aid therapeutic decisions and triage. The American Society of Anesthesiologists Physical Status (ASA-PS) classification system is included in templates for reporting data in physician-staffed pre-hospital emergency medical services (p-EMS) but whether an adequate full pre-event ASA-PS can be assessed by pre-hospital physicians remains unknown. We aimed to explore whether pre-hospital physicians can score an adequate pre-event ASA-PS with the information available on-scene.

Methods

The study was an inter-rater reliability study consisting of two steps. Pre-event ASA-PS scores made by pre- and in-hospital physicians were compared. Pre-hospital physicians did not have access to patient records and scores were based on information obtainable on-scene. In-hospital physicians used the complete patient record (Step 1). To assess inter-rater reliability between pre- and in-hospital physicians when given equal amounts of information, pre-hospital physicians also assigned pre-event ASA-PS for 20 of the included patients by using the complete patient records (Step 2). Inter-rater reliability was analyzed using quadratic weighted Cohen’s kappa (κw).

Results

For most scores (82%) inter-rater reliability between pre-and in-hospital physicians were moderate to substantial (κw 0,47-0,89). Inter-rater reliability was higher among the in-hospital physicians (κw 0,77 to 0.85). When all physicians had access to the same information, κw increased (κw 0,65 to 0,93).

Conclusions

Pre-hospital physicians can score an adequate pre-event ASA-PS on-scene for most patients. To further increase inter-rater reliability, we recommend access to the full patient journal on-scene. We recommend application of the full ASA-PS classification system for reporting of comorbidity in p-EMS.
Literature
1.
go back to reference Garrison HG, Maio RF, Spaite DW, Desmond JS, Gregor MA, O'Malley PJ, Stiell IG, Cayten CG, Chew JL Jr, Mackenzie EJ, Miller DR. Emergency medical services outcomes project III (EMSOP III): the role of risk adjustment in out-of-hospital outcomes research. Ann Emerg Med. 2002;40:79–88.CrossRef Garrison HG, Maio RF, Spaite DW, Desmond JS, Gregor MA, O'Malley PJ, Stiell IG, Cayten CG, Chew JL Jr, Mackenzie EJ, Miller DR. Emergency medical services outcomes project III (EMSOP III): the role of risk adjustment in out-of-hospital outcomes research. Ann Emerg Med. 2002;40:79–88.CrossRef
2.
go back to reference Keim SM, Spaite DW, Maio RF, Garrison HG, Desmond JS, Gregor MA, O'Malley PJ, Stiell IG, Cayten CG, Chew JL Jr, et al. Risk adjustment and outcome measures for out-of-hospital respiratory distress. Acad Emerg Med. 2004;11:1074–81.CrossRef Keim SM, Spaite DW, Maio RF, Garrison HG, Desmond JS, Gregor MA, O'Malley PJ, Stiell IG, Cayten CG, Chew JL Jr, et al. Risk adjustment and outcome measures for out-of-hospital respiratory distress. Acad Emerg Med. 2004;11:1074–81.CrossRef
3.
go back to reference Van Gelder IC, Hobbelt AH, Marcos EG, Schotten U, Cappato R, Lewalter T, Schwieler J, Rienstra M, Boriani G. Tailored treatment strategies: a new approach for modern management of atrial fibrillation. J Intern Med. 2016;279:457–66.CrossRef Van Gelder IC, Hobbelt AH, Marcos EG, Schotten U, Cappato R, Lewalter T, Schwieler J, Rienstra M, Boriani G. Tailored treatment strategies: a new approach for modern management of atrial fibrillation. J Intern Med. 2016;279:457–66.CrossRef
4.
go back to reference Miller RD. Miller’s Anestehesia 6th edition. In: Miller RD, editor. Miller’s Anestehsia, vol. 1. Philadelphia: Elsevier Churcuill Livingstone; 2005. p. 1018. Miller RD. Miller’s Anestehesia 6th edition. In: Miller RD, editor. Miller’s Anestehsia, vol. 1. Philadelphia: Elsevier Churcuill Livingstone; 2005. p. 1018.
5.
6.
go back to reference Ghosh R, Pepe P. The critical care cascade: a systems approach. Curr Opin Crit Care. 2009;15:279–83.CrossRef Ghosh R, Pepe P. The critical care cascade: a systems approach. Curr Opin Crit Care. 2009;15:279–83.CrossRef
7.
go back to reference Scalea TM, Simon HM, Duncan AO, Atweh NA, Sclafani SJ, Phillips TF, Shaftan GW. Geriatric blunt multiple trauma: improved survival with early invasive monitoring. J Trauma. 1990;30:129–34 discussion 134-126.CrossRef Scalea TM, Simon HM, Duncan AO, Atweh NA, Sclafani SJ, Phillips TF, Shaftan GW. Geriatric blunt multiple trauma: improved survival with early invasive monitoring. J Trauma. 1990;30:129–34 discussion 134-126.CrossRef
8.
go back to reference Skaga NO, Eken T, Sovik S, Jones JM, Steen PA. Pre-injury ASA physical status classification is an independent predictor of mortality after trauma. J Trauma. 2007;63:972–8.CrossRef Skaga NO, Eken T, Sovik S, Jones JM, Steen PA. Pre-injury ASA physical status classification is an independent predictor of mortality after trauma. J Trauma. 2007;63:972–8.CrossRef
9.
go back to reference Bouamra O, Jacques R, Edwards A, Yates DW, Lawrence T, Jenks T, Woodford M, Lecky F. Prediction modelling for trauma using comorbidity and ‘true’ 30-day outcome. Emerg Med J. 2015;32:933–8.CrossRef Bouamra O, Jacques R, Edwards A, Yates DW, Lawrence T, Jenks T, Woodford M, Lecky F. Prediction modelling for trauma using comorbidity and ‘true’ 30-day outcome. Emerg Med J. 2015;32:933–8.CrossRef
10.
go back to reference Ghorbani P, Ringdal KG, Hestnes M, Skaga NO, Eken T, Ekbom A, Strommer L. Comparison of risk-adjusted survival in two Scandinavian level-I trauma centres. Scand J Trauma Resusc Emerg Med. 2016;24:66.CrossRef Ghorbani P, Ringdal KG, Hestnes M, Skaga NO, Eken T, Ekbom A, Strommer L. Comparison of risk-adjusted survival in two Scandinavian level-I trauma centres. Scand J Trauma Resusc Emerg Med. 2016;24:66.CrossRef
11.
go back to reference Jones JM, Skaga NO, Sovik S, Lossius HM, Eken T. Norwegian survival prediction model in trauma: modelling effects of anatomic injury, acute physiology, age, and co-morbidity. Acta Anaesthesiol Scand. 2014;58:303–15.CrossRef Jones JM, Skaga NO, Sovik S, Lossius HM, Eken T. Norwegian survival prediction model in trauma: modelling effects of anatomic injury, acute physiology, age, and co-morbidity. Acta Anaesthesiol Scand. 2014;58:303–15.CrossRef
12.
go back to reference de Munter L, Polinder S, Lansink KW, Cnossen MC, Steyerberg EW, de Jongh MA. Mortality prediction models in the general trauma population: a systematic review. Injury. 2017;48:221–9.CrossRef de Munter L, Polinder S, Lansink KW, Cnossen MC, Steyerberg EW, de Jongh MA. Mortality prediction models in the general trauma population: a systematic review. Injury. 2017;48:221–9.CrossRef
13.
go back to reference Austin SR, Wong YN, Uzzo RG, Beck JR, Egleston BL. Why summary comorbidity measures such as the Charlson comorbidity index and Elixhauser score work. Med Care. 2015;53:e65–72.CrossRef Austin SR, Wong YN, Uzzo RG, Beck JR, Egleston BL. Why summary comorbidity measures such as the Charlson comorbidity index and Elixhauser score work. Med Care. 2015;53:e65–72.CrossRef
14.
go back to reference Keats AS. The ASA classification of physical status--a recapitulation. Anesthesiology. 1978;49:233–6.CrossRef Keats AS. The ASA classification of physical status--a recapitulation. Anesthesiology. 1978;49:233–6.CrossRef
15.
go back to reference Saklad M. Grading of patients for surgical procedures. Anesthesiology. 1941;2:281–4.CrossRef Saklad M. Grading of patients for surgical procedures. Anesthesiology. 1941;2:281–4.CrossRef
16.
go back to reference Sankar A, Johnson SR, Beattie WS, Tait G, Wijeysundera DN. Reliability of the American Society of Anesthesiologists physical status scale in clinical practice. Br J Anaesth. 2014;113:424–32.CrossRef Sankar A, Johnson SR, Beattie WS, Tait G, Wijeysundera DN. Reliability of the American Society of Anesthesiologists physical status scale in clinical practice. Br J Anaesth. 2014;113:424–32.CrossRef
18.
go back to reference Ringdal KG, Coats TJ, Lefering R, Di Bartolomeo S, Steen PA, Roise O, Handolin L, Lossius HM. The Utstein template for uniform reporting of data following major trauma: a joint revision by SCANTEM, TARN, DGU-TR and RITG. Scand J Trauma Resusc Emerg Med. 2008;16:7.CrossRef Ringdal KG, Coats TJ, Lefering R, Di Bartolomeo S, Steen PA, Roise O, Handolin L, Lossius HM. The Utstein template for uniform reporting of data following major trauma: a joint revision by SCANTEM, TARN, DGU-TR and RITG. Scand J Trauma Resusc Emerg Med. 2008;16:7.CrossRef
19.
go back to reference Tønsager K, Krüger AJ, Ringdal KG, Rehn M. Template for documenting and reporting data in physician-staffed pre-hospital services: a consensus-based update. Scand J Trauma Resusc Emerg Med. 2020;28:25.CrossRef Tønsager K, Krüger AJ, Ringdal KG, Rehn M. Template for documenting and reporting data in physician-staffed pre-hospital services: a consensus-based update. Scand J Trauma Resusc Emerg Med. 2020;28:25.CrossRef
20.
go back to reference Kruger AJ, Lockey D, Kurola J, Di Bartolomeo S, Castren M, Mikkelsen S, Lossius HM. A consensus-based template for documenting and reporting in physician-staffed pre-hospital services. Scand J Trauma Resusc Emerg Med. 2011;19:71.CrossRef Kruger AJ, Lockey D, Kurola J, Di Bartolomeo S, Castren M, Mikkelsen S, Lossius HM. A consensus-based template for documenting and reporting in physician-staffed pre-hospital services. Scand J Trauma Resusc Emerg Med. 2011;19:71.CrossRef
21.
go back to reference Ringdal KG, Skaga NO, Steen PA, Hestnes M, Laake P, Jones JM, Lossius HM. Classification of comorbidity in trauma: the reliability of pre-injury ASA physical status classification. Injury. 2013;44:29–35.CrossRef Ringdal KG, Skaga NO, Steen PA, Hestnes M, Laake P, Jones JM, Lossius HM. Classification of comorbidity in trauma: the reliability of pre-injury ASA physical status classification. Injury. 2013;44:29–35.CrossRef
22.
go back to reference Kirby A, Gebski V, Keech AC. Determining the sample size in a clinical trial. Med J Aust. 2002;177:256–7.CrossRef Kirby A, Gebski V, Keech AC. Determining the sample size in a clinical trial. Med J Aust. 2002;177:256–7.CrossRef
23.
go back to reference Kadam P, Bhalerao S. Sample size calculation. Int J Ayurveda Res. 2010;1:55–7.CrossRef Kadam P, Bhalerao S. Sample size calculation. Int J Ayurveda Res. 2010;1:55–7.CrossRef
24.
go back to reference Corder GW, Foreman DI. Nonparametric statistics for non-statisticians. Hoboken: Wiley; 2009. Corder GW, Foreman DI. Nonparametric statistics for non-statisticians. Hoboken: Wiley; 2009.
25.
go back to reference Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, Roberts C, Shoukri M, Streiner DL. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.CrossRef Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, Roberts C, Shoukri M, Streiner DL. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.CrossRef
26.
go back to reference Hallgren KA. Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol. 2012;8:23–34.CrossRef Hallgren KA. Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol. 2012;8:23–34.CrossRef
27.
go back to reference Shrout PE. Measurement reliability and agreement in psychiatry. Stat Methods Med Res. 1998;7:301–17.CrossRef Shrout PE. Measurement reliability and agreement in psychiatry. Stat Methods Med Res. 1998;7:301–17.CrossRef
28.
go back to reference Zou KH, Warfield SK, Bharatha A, Tempany CM, Kaus MR, Haker SJ, Wells WM 3rd, Jolesz FA, Kikinis R. Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol. 2004;11:178–89.CrossRef Zou KH, Warfield SK, Bharatha A, Tempany CM, Kaus MR, Haker SJ, Wells WM 3rd, Jolesz FA, Kikinis R. Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol. 2004;11:178–89.CrossRef
29.
go back to reference Bien J, Tibshirani R. Hierarchical clustering with prototypes via Minimax linkage. J Am Stat Assoc. 2011;106:1075–84.CrossRef Bien J, Tibshirani R. Hierarchical clustering with prototypes via Minimax linkage. J Am Stat Assoc. 2011;106:1075–84.CrossRef
30.
go back to reference Fiori S, Tanaka T. An algorithm to compute averages on matrix lie groups. Trans Sig Proc. 2009;57:4734–43.CrossRef Fiori S, Tanaka T. An algorithm to compute averages on matrix lie groups. Trans Sig Proc. 2009;57:4734–43.CrossRef
31.
go back to reference Bergeron E, Rossignol M, Osler T, Clas D, Lavoie A. Improving the TRISS methodology by restructuring age categories and adding comorbidities. J Trauma. 2004;56:760–7.CrossRef Bergeron E, Rossignol M, Osler T, Clas D, Lavoie A. Improving the TRISS methodology by restructuring age categories and adding comorbidities. J Trauma. 2004;56:760–7.CrossRef
32.
go back to reference Skaga NO, Eken T, Sovik S. Validating performance of TRISS, TARN and NORMIT survival prediction models in a Norwegian trauma population. Acta Anaesthesiol Scand. 2018;62:253–66.CrossRef Skaga NO, Eken T, Sovik S. Validating performance of TRISS, TARN and NORMIT survival prediction models in a Norwegian trauma population. Acta Anaesthesiol Scand. 2018;62:253–66.CrossRef
33.
go back to reference Riley R, Holman C, Fletcher D. Inter-rater reliability of the ASA physical status classification in a sample of anaesthetists in Western Australia. Anaesth Intensive Care. 2014;42:614–8.CrossRef Riley R, Holman C, Fletcher D. Inter-rater reliability of the ASA physical status classification in a sample of anaesthetists in Western Australia. Anaesth Intensive Care. 2014;42:614–8.CrossRef
34.
go back to reference Curatolo C, Goldberg A, Maerz D, Lin HM, Shah H, Trinh M. ASA physical status assignment by non-anesthesia providers: do surgeons consistently downgrade the ASA score preoperatively? J Clin Anesth. 2017;38:123–8.CrossRef Curatolo C, Goldberg A, Maerz D, Lin HM, Shah H, Trinh M. ASA physical status assignment by non-anesthesia providers: do surgeons consistently downgrade the ASA score preoperatively? J Clin Anesth. 2017;38:123–8.CrossRef
35.
go back to reference Ihejirika RC, Thakore RV, Sathiyakumar V, Ehrenfeld JM, Obremskey WT, Sethi MK. An assessment of the inter-rater reliability of the ASA physical status score in the orthopaedic trauma population. Injury. 2015;46:542–6.CrossRef Ihejirika RC, Thakore RV, Sathiyakumar V, Ehrenfeld JM, Obremskey WT, Sethi MK. An assessment of the inter-rater reliability of the ASA physical status score in the orthopaedic trauma population. Injury. 2015;46:542–6.CrossRef
36.
go back to reference Jones EW. How summary care records can improve patient safety. Emerg Nurse. 2015;23:20–2.CrossRef Jones EW. How summary care records can improve patient safety. Emerg Nurse. 2015;23:20–2.CrossRef
Metadata
Title
Assignment of pre-event ASA physical status classification by pre-hospital physicians: a prospective inter-rater reliability study
Authors
Kristin Tønsager
Marius Rehn
Andreas J. Krüger
Jo Røislien
Kjetil G. Ringdal
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Care
Published in
BMC Anesthesiology / Issue 1/2020
Electronic ISSN: 1471-2253
DOI
https://doi.org/10.1186/s12871-020-01083-x

Other articles of this Issue 1/2020

BMC Anesthesiology 1/2020 Go to the issue