Skip to main content
Top
Published in: International Journal of Emergency Medicine 1/2020

Open Access 01-12-2020 | Triage | Original Research

Performance of a three-level triage scale in live triage encounters in an emergency department in Hong Kong

Authors: Rex Pui Kin Lam, Shing Lam Kwok, Vi Ka Chaang, Lujie Chen, Eric Ho Yin Lau, Kin Ling Chan

Published in: International Journal of Emergency Medicine | Issue 1/2020

Login to get access

Abstract

Background

Despite its continued use in many low-volume emergency departments (EDs), 3-level triage systems have not been extensively studied, especially on live triage cases. We have modified from the Australasian Triage Scale and developed a 3-level triage scale, and sought to evaluate its validity, reliability, and over- and under-triage rates in real patient encounters in our setting.

Method

This was a cross-sectional study in a single ED with 24,000 attendances per year. At triage, each patient was simultaneously assessed by a triage nurse, an adjudicator (the “criterion standard”), and a study nurse independently. Predictive validity was determined by comparing clinical outcomes, such as hospitalization, across triage levels. The discriminating performance of the triage tool in identifying patients requiring earlier medical attention was determined. Inter-observer reliability between the triage nurse and criterion standard, and across providers were determined using kappa statistics.

Results

In total, 453 triage ratings of 151 triage cases, involving 17 ED triage nurses and 57 nurse pairs, were analysed. The proportion of hospital admission significantly increased with a higher triage rating. The performance of the scale in identifying patients requiring earlier medical attention was as follows: sensitivity, 68.2% (95% CI 45.1–86.1%); specificity, 99.2% (95% CI 95.8–100%); positive predictive value, 93.8% (95% CI 67.6–99.1%); and negative predictive value, 94.8% (95% CI 90.8–97.1%). The over-triage and under-triage rates were 0.7% and 4.6%, respectively. Agreement between the triage nurse and criterion standard was substantial (quadratic-weighted kappa = 0.76, 95% CI, 0.60–0.92, p < 0.001), so was the agreement across nurses (quadratic-weighted kappa = 0.81, 95% CI 0.65–0.97, p < 0.001).

Conclusions

The 3-level triage system appears to have good validity and reasonable reliability in a low-volume ED setting. Further studies comparing 3-level and prevailing 5-level triage scales in live triage encounters and different ED settings are warranted.
Appendix
Available only for authorised users
Literature
3.
go back to reference Beveridge R, Clarke B, Janes L,Savage N, Thompson J, Dodd G, et al. Canadian Emergency Department Triage and Acuity Scale implementation guidelines. CJEM 1999;1 Suppl S1– A24. Beveridge R, Clarke B, Janes L,Savage N, Thompson J, Dodd G, et al. Canadian Emergency Department Triage and Acuity Scale implementation guidelines. CJEM 1999;1 Suppl S1– A24.
4.
go back to reference Mackway-Jones Ke. Emergency triage: Manchester Triage Group. London: BMJ Publishing Group, London, UK, 1997. Mackway-Jones Ke. Emergency triage: Manchester Triage Group. London: BMJ Publishing Group, London, UK, 1997.
5.
go back to reference Gilboy N, Tanabe T, Travers D, Rosenau AM. Emergency Severity Index (ESI): a triage tool for emergency department care, version 4. Implementation Handbook 2012 Edition. AHRQ Publication No.12-0014. Rockville, MD. Agency for Healthcare Research and Quality. November 2011. Gilboy N, Tanabe T, Travers D, Rosenau AM. Emergency Severity Index (ESI): a triage tool for emergency department care, version 4. Implementation Handbook 2012 Edition. AHRQ Publication No.12-0014. Rockville, MD. Agency for Healthcare Research and Quality. November 2011.
7.
go back to reference Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Dtsch Arztebl Int. 2010;107(50):892–8.PubMedPubMedCentral Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Dtsch Arztebl Int. 2010;107(50):892–8.PubMedPubMedCentral
8.
go back to reference Hinson JS, Martinez DA, Cabral S, George K, Whalen M, Hansoti B, et al. Triage performance in emergency medicine: a systematic review. Ann Emerg Med. 2019;74:140–52.CrossRef Hinson JS, Martinez DA, Cabral S, George K, Whalen M, Hansoti B, et al. Triage performance in emergency medicine: a systematic review. Ann Emerg Med. 2019;74:140–52.CrossRef
9.
go back to reference Farrohknia N, Castrén M, Ehrenberg A, Lind L, Oredsson S, Jonsson H, et al. Emergency department triage scales and their components: a systematic review of the scientific evidence. Scand J Trauma Resusc Emerg Med. 2011;19:42.CrossRef Farrohknia N, Castrén M, Ehrenberg A, Lind L, Oredsson S, Jonsson H, et al. Emergency department triage scales and their components: a systematic review of the scientific evidence. Scand J Trauma Resusc Emerg Med. 2011;19:42.CrossRef
10.
go back to reference McHugh M, Tanabe P, McClelland M, Khare RK. More patients are triaged using the emergency severity index than any other triage acuity system in the United States. Acad Emerg Med. 2012;19:106–9.CrossRef McHugh M, Tanabe P, McClelland M, Khare RK. More patients are triaged using the emergency severity index than any other triage acuity system in the United States. Acad Emerg Med. 2012;19:106–9.CrossRef
11.
go back to reference Fernandes CM, Tanabe P, Gilboy N, Johnson LA, McNair RS, Rosenau AM, et al. Five-level triage: a report from the ACEP/ENA five-level triage task force. J Emerg Nurs. 2005;31(1):39–50.CrossRef Fernandes CM, Tanabe P, Gilboy N, Johnson LA, McNair RS, Rosenau AM, et al. Five-level triage: a report from the ACEP/ENA five-level triage task force. J Emerg Nurs. 2005;31(1):39–50.CrossRef
12.
go back to reference Wuerz R, Fernandes CMB, Alarcon J. Inconsistency of emergency department triage. Ann Emerg Med. 1998;32(4):431–5.CrossRef Wuerz R, Fernandes CMB, Alarcon J. Inconsistency of emergency department triage. Ann Emerg Med. 1998;32(4):431–5.CrossRef
13.
go back to reference Travers DA, Waller AE, Bowling JM, Flowers D, Tintinalli J. Five-level triage system more effective than three-level in tertiary emergency department. J Emerg Nurs. 2002;28(5):395–400.CrossRef Travers DA, Waller AE, Bowling JM, Flowers D, Tintinalli J. Five-level triage system more effective than three-level in tertiary emergency department. J Emerg Nurs. 2002;28(5):395–400.CrossRef
14.
go back to reference Erimșah ME, Yaka E, Yilmaz S, Kama A, Pekdemir M. Inter-rater reliability and validity of the Ministry of Health of Turkey’s mandatory emergency triage instrument. Emerg Med Aust. 2015;27:210–5.CrossRef Erimșah ME, Yaka E, Yilmaz S, Kama A, Pekdemir M. Inter-rater reliability and validity of the Ministry of Health of Turkey’s mandatory emergency triage instrument. Emerg Med Aust. 2015;27:210–5.CrossRef
15.
go back to reference Task Group on Best Practice, COC (A&E) Nursing Development Subcommittee, Hospital Authority. A&E Triage Guidelines. Hong Kong: Hospital Authority; 2016. Task Group on Best Practice, COC (A&E) Nursing Development Subcommittee, Hospital Authority. A&E Triage Guidelines. Hong Kong: Hospital Authority; 2016.
16.
go back to reference Fan MMW, Leung LP. Validation of the Hong Kong accident and emergency triage guidelines. Hong Kong Med J. 2013;19(3):198–202.PubMed Fan MMW, Leung LP. Validation of the Hong Kong accident and emergency triage guidelines. Hong Kong Med J. 2013;19(3):198–202.PubMed
20.
go back to reference Altman D. Practical statistics for medical research, Chapman & Hall. London: UK; 1991. Altman D. Practical statistics for medical research, Chapman & Hall. London: UK; 1991.
21.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRef Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRef
22.
go back to reference Sim J, Wrigth CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85(3):257–68.CrossRef Sim J, Wrigth CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85(3):257–68.CrossRef
23.
go back to reference Bujang MA, Baharum N. Guidelines of the minimum sample size requirements for Cohen’s Kappa. Epidemiol Biostat Public Health. 2017;14(2):e12267 -1-10. Bujang MA, Baharum N. Guidelines of the minimum sample size requirements for Cohen’s Kappa. Epidemiol Biostat Public Health. 2017;14(2):e12267 -1-10.
24.
go back to reference Worster A, Sardo A, Eva K, Fernandes CM, Upadhye S. Triage tool inter-rater reliability: a comparison of live versus paper case scenarios. J Emerg Nurs. 2007;33:319–23.CrossRef Worster A, Sardo A, Eva K, Fernandes CM, Upadhye S. Triage tool inter-rater reliability: a comparison of live versus paper case scenarios. J Emerg Nurs. 2007;33:319–23.CrossRef
25.
go back to reference Considine J, LeVasseur SA, Villanueva E. The Australasian triage scale: examining emergency department nurses’ performance using computer and paper scenarios. Ann Emerg Med. 2004;44(5):516–23.CrossRef Considine J, LeVasseur SA, Villanueva E. The Australasian triage scale: examining emergency department nurses’ performance using computer and paper scenarios. Ann Emerg Med. 2004;44(5):516–23.CrossRef
26.
go back to reference Göransson K, Ehrenberg A, Marklund B, Ehnfors M. Accuracy and concordance of nurses in emergency department triage. Scan J Caring Sci. 2005;19:432–8.CrossRef Göransson K, Ehrenberg A, Marklund B, Ehnfors M. Accuracy and concordance of nurses in emergency department triage. Scan J Caring Sci. 2005;19:432–8.CrossRef
29.
go back to reference Van der Wulp I, Can Baar ME, Schrijvers AJ. Reliability and validity of the Manchester triage system in a general emergency department patient population in the Netherlands: results of a simulation study. Emerg Med J. 2008;25:431–4.CrossRef Van der Wulp I, Can Baar ME, Schrijvers AJ. Reliability and validity of the Manchester triage system in a general emergency department patient population in the Netherlands: results of a simulation study. Emerg Med J. 2008;25:431–4.CrossRef
31.
go back to reference Wuerz RC, Milne L, Eitel DR, Travers D, Gilboy N. Reliability and validity of a new few-level triage instrument. Acad Emerg Med. 2000;7:236–42.CrossRef Wuerz RC, Milne L, Eitel DR, Travers D, Gilboy N. Reliability and validity of a new few-level triage instrument. Acad Emerg Med. 2000;7:236–42.CrossRef
32.
go back to reference Grossmann FF, Nickel CH, Christ M, Schneider K, Spirig R, Bingisser R. Transporting clinical tools to new settings: cultural adaptation and validation of the emergency severity index in German. Ann Emerg Med. 2011;57:257–64.CrossRef Grossmann FF, Nickel CH, Christ M, Schneider K, Spirig R, Bingisser R. Transporting clinical tools to new settings: cultural adaptation and validation of the emergency severity index in German. Ann Emerg Med. 2011;57:257–64.CrossRef
33.
go back to reference Wuerz RC, Travers D, Gilboy N, Eitel DR, Rosenau A, Yazhari R. Implementation and refinement of the emergency severity index. Acad Emerg Med. 2001;8:170–6.CrossRef Wuerz RC, Travers D, Gilboy N, Eitel DR, Rosenau A, Yazhari R. Implementation and refinement of the emergency severity index. Acad Emerg Med. 2001;8:170–6.CrossRef
34.
go back to reference Tanabe P, Gimbel R, Yarnold PR, Kyriacou DN, Adams JG. Reliability and validity of scores on the emergency severity index version 3. Acad Emerg Med. 2004;11(1):59–65.CrossRef Tanabe P, Gimbel R, Yarnold PR, Kyriacou DN, Adams JG. Reliability and validity of scores on the emergency severity index version 3. Acad Emerg Med. 2004;11(1):59–65.CrossRef
35.
go back to reference Dong SL, Bullard MJ, Meurer DP, Blitz S, Ohinmaa A, Holroyd BR, et al. Reliability of computerized emergency triage. Acad Emerg Med. 2006;13:269–75.CrossRef Dong SL, Bullard MJ, Meurer DP, Blitz S, Ohinmaa A, Holroyd BR, et al. Reliability of computerized emergency triage. Acad Emerg Med. 2006;13:269–75.CrossRef
36.
go back to reference Dong SL, Bullard MJ, Meurer DP, Blitz S, Holroyd BR. The effect of training on nurse agreement using an electronic triage system. CJEM. 2007;9(4):261–6.CrossRef Dong SL, Bullard MJ, Meurer DP, Blitz S, Holroyd BR. The effect of training on nurse agreement using an electronic triage system. CJEM. 2007;9(4):261–6.CrossRef
38.
go back to reference Beveridge R, Ducharme J, Janes L, Beaulieu S, Walter S. Reliability of the Canadian emergency department triage and acuity scale: interrater agreement. Ann Emerg Med. 1999;34:155–9.CrossRef Beveridge R, Ducharme J, Janes L, Beaulieu S, Walter S. Reliability of the Canadian emergency department triage and acuity scale: interrater agreement. Ann Emerg Med. 1999;34:155–9.CrossRef
41.
go back to reference Chung JY. An exploration of accident and emergency nurse experience of triage decision making in Hong Kong. Accid Emerg Nurs. 2005;13:260–13.CrossRef Chung JY. An exploration of accident and emergency nurse experience of triage decision making in Hong Kong. Accid Emerg Nurs. 2005;13:260–13.CrossRef
42.
go back to reference Grafstein E, Innes G, Westman J, Christenson J, Thorne A. Inter-rater reliability of a computerized presenting-complaint-linked triage system in an urban emergency department. CJEM. 2003;5(5):323–9.PubMed Grafstein E, Innes G, Westman J, Christenson J, Thorne A. Inter-rater reliability of a computerized presenting-complaint-linked triage system in an urban emergency department. CJEM. 2003;5(5):323–9.PubMed
43.
go back to reference Levin S, Toerper M, Hinson JS HE, Barnes S, Gardner H, et al. Machine-learning-based electronic triage more accurately differentiates patients with respect to clinical outcomes compared with the emergency severity index. Ann Emerg Med. 2018;71:565–74.CrossRef Levin S, Toerper M, Hinson JS HE, Barnes S, Gardner H, et al. Machine-learning-based electronic triage more accurately differentiates patients with respect to clinical outcomes compared with the emergency severity index. Ann Emerg Med. 2018;71:565–74.CrossRef
44.
go back to reference Dugas AF, Kirsch TD, Toerper M, Korley F, Yenokyan G, France D, et al. An electronic emergency triage system to improve patient distribution by critical outcomes. J Emerg Med. 2016;50:910–8.CrossRef Dugas AF, Kirsch TD, Toerper M, Korley F, Yenokyan G, France D, et al. An electronic emergency triage system to improve patient distribution by critical outcomes. J Emerg Med. 2016;50:910–8.CrossRef
45.
go back to reference McLoed SL, McCarron J, Ahmed T, Grewal K, Mittmann N, Scott S, et al. Interrater reliability, accuracy, and triage time pre- and post-implementation of a real-time electronic triage decision-support tool. Ann Emerg Med. 2019. McLoed SL, McCarron J, Ahmed T, Grewal K, Mittmann N, Scott S, et al. Interrater reliability, accuracy, and triage time pre- and post-implementation of a real-time electronic triage decision-support tool. Ann Emerg Med. 2019.
Metadata
Title
Performance of a three-level triage scale in live triage encounters in an emergency department in Hong Kong
Authors
Rex Pui Kin Lam
Shing Lam Kwok
Vi Ka Chaang
Lujie Chen
Eric Ho Yin Lau
Kin Ling Chan
Publication date
01-12-2020
Publisher
Springer Berlin Heidelberg
Keyword
Triage
Published in
International Journal of Emergency Medicine / Issue 1/2020
Print ISSN: 1865-1372
Electronic ISSN: 1865-1380
DOI
https://doi.org/10.1186/s12245-020-00288-8

Other articles of this Issue 1/2020

International Journal of Emergency Medicine 1/2020 Go to the issue