Skip to main content
Top
Published in: BMC Emergency Medicine 1/2021

Open Access 01-12-2021 | Triage | Research article

Validity and reliability of the South African Triage Scale in prehospital providers

Authors: Nee-Kofi Mould-Millman, Julia M. Dixon, Taylor Burkholder, Jennifer L. Pigoga, Michael Lee, Shaheem de Vries, Kubendhren Moodley, Maxene Meier, Kathryn Colborn, Chandni Patel, Lee A. Wallis

Published in: BMC Emergency Medicine | Issue 1/2021

Login to get access

Abstract

Background

The South African Triage Scale (SATS) is a validated in-hospital triage tool that has been innovatively adopted for use in the prehospital setting by Western Cape Government (WCG) Emergency Medical Services (EMS) in South Africa. The performance of SATS by EMS providers has not been formally assessed. The study sought to assess the validity and reliability of SATS when used by WCG EMS prehospital providers for single-patient triage.

Methods

This is a prospective, assessment-based validation study among WCG EMS providers from March to September 2017 in Cape Town, South Africa. Participants completed an assessment containing 50 clinical vignettes by calculating the three components — triage early warning score (TEWS), discriminators (pre-defined clinical conditions), and a final SATS triage color. Responses were scored against gold standard answers. Validity was assessed by calculating over- and under-triage rates compared to gold standard. Inter-rater reliability was assessed by calculating agreement among EMS providers’ responses.

Results

A total of 102 EMS providers completed the assessment. The final SATS triage color was accurately determined in 56.5%, under-triaged in 29.5%, and over-triaged in 13.1% of vignette responses. TEWS was calculated correctly in 42.6% of vignettes, under-calculated in 45.0% and over-calculated in 10.9%. Discriminators were correctly identified in only 58.8% of vignettes. There was substantial inter-rater and gold standard agreement for both the TEWS component and final SATS color, but there was lower inter-rater agreement for clinical discriminators.

Conclusion

This is the first assessment of SATS as used by EMS providers for prehospital triage. We found that SATS generally under-performed as a triage tool, mainly due to the clinical discriminators. We found good inter-rater reliability, but poor validity. The under-triage rate of 30% was higher than previous reports from the in-hospital setting. The over-triage rate of 13% was acceptable. Further clinically-based and qualitative studies are needed.

Trial registration

Not applicable.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mistry B, Stewart De Ramirez S, Kelen G, et al. Accuracy and reliability of emergency department triage using the emergency severity index: an International Multicenter Assessment. Ann Emerg Med. 2018;71(5):581–587.e583.CrossRef Mistry B, Stewart De Ramirez S, Kelen G, et al. Accuracy and reliability of emergency department triage using the emergency severity index: an International Multicenter Assessment. Ann Emerg Med. 2018;71(5):581–587.e583.CrossRef
2.
go back to reference Twomey M, Wallis LA, Thompson ML, Myers JE. The south African triage scale (adult version) provides reliable acuity ratings when used by doctors and enrolled nursing assistants. Afr J Emerg Med. 2012;2(1):3–12.CrossRef Twomey M, Wallis LA, Thompson ML, Myers JE. The south African triage scale (adult version) provides reliable acuity ratings when used by doctors and enrolled nursing assistants. Afr J Emerg Med. 2012;2(1):3–12.CrossRef
3.
go back to reference Fernandes CM, McLeod S, Krause J, et al. Reliability of the Canadian triage and acuity scale: interrater and intrarater agreement from a community and an academic emergency department. CJEM. 2013;15(4):227–32.CrossRef Fernandes CM, McLeod S, Krause J, et al. Reliability of the Canadian triage and acuity scale: interrater and intrarater agreement from a community and an academic emergency department. CJEM. 2013;15(4):227–32.CrossRef
4.
go back to reference Jenson A, Hansoti B, Rothman R, de Ramirez SS, Lobner K, Wallis L. Reliability and validity of emergency department triage tools in low- and middle-income countries: a systematic review. Eur J Emerg Med. 2018;25(3):154–60.CrossRef Jenson A, Hansoti B, Rothman R, de Ramirez SS, Lobner K, Wallis L. Reliability and validity of emergency department triage tools in low- and middle-income countries: a systematic review. Eur J Emerg Med. 2018;25(3):154–60.CrossRef
5.
go back to reference Gottschalk SB, Wood D, DeVries S, Wallis LA, Bruijns S. The cape triage score: a new triage system South Africa. Proposal from the cape triage group. Emerg Med J. 2006;23(2):149–53.CrossRef Gottschalk SB, Wood D, DeVries S, Wallis LA, Bruijns S. The cape triage score: a new triage system South Africa. Proposal from the cape triage group. Emerg Med J. 2006;23(2):149–53.CrossRef
6.
go back to reference Rosedale K, Smith ZA, Davies H, Wood D. The effectiveness of the south African triage score (SATS) in a rural emergency department. S Afr Med J. 2011;101(8):537–40.PubMed Rosedale K, Smith ZA, Davies H, Wood D. The effectiveness of the south African triage score (SATS) in a rural emergency department. S Afr Med J. 2011;101(8):537–40.PubMed
7.
go back to reference Sunyoto T, Van den Bergh R, Valles P, et al. Providing emergency care and assessing a patient triage system in a referral hospital in Somaliland: a cross-sectional study. BMC Health Serv Res. 2014;14:531.CrossRef Sunyoto T, Van den Bergh R, Valles P, et al. Providing emergency care and assessing a patient triage system in a referral hospital in Somaliland: a cross-sectional study. BMC Health Serv Res. 2014;14:531.CrossRef
8.
go back to reference Dalwai MK, Twomey M, Maikere J, et al. Reliability and accuracy of the south African triage scale when used by nurses in the emergency department of Timergara Hospital, Pakistan. S Afr Med J. 2014;104(5):372–5.CrossRef Dalwai MK, Twomey M, Maikere J, et al. Reliability and accuracy of the south African triage scale when used by nurses in the emergency department of Timergara Hospital, Pakistan. S Afr Med J. 2014;104(5):372–5.CrossRef
9.
go back to reference Twomey M, Wallis LA, Thompson ML, Myers JE. The south African triage scale (adult version) provides reliable acuity ratings. Int Emerg Nurs. 2012;20(3):142–50.CrossRef Twomey M, Wallis LA, Thompson ML, Myers JE. The south African triage scale (adult version) provides reliable acuity ratings. Int Emerg Nurs. 2012;20(3):142–50.CrossRef
12.
go back to reference Mould-Millman NK, Dixon J, Lamp A, et al. A single-site pilot implementation of a novel trauma training program for prehospital providers in a resource-limited setting. Pilot Feasibility Stud. 2019;5:143.CrossRef Mould-Millman NK, Dixon J, Lamp A, et al. A single-site pilot implementation of a novel trauma training program for prehospital providers in a resource-limited setting. Pilot Feasibility Stud. 2019;5:143.CrossRef
13.
go back to reference Sasser SM, Hunt RC, Faul M, et al. Guidelines for field triage of injured patients: recommendations of the National Expert Panel on Field Triage, 2011. MMWR Recomm Rep. 2012;61(Rr-1):1–20.PubMed Sasser SM, Hunt RC, Faul M, et al. Guidelines for field triage of injured patients: recommendations of the National Expert Panel on Field Triage, 2011. MMWR Recomm Rep. 2012;61(Rr-1):1–20.PubMed
14.
go back to reference Sobuwa S, Christopher L. Emergency care education in South Africa: past, present and future. Aust J Paramed. 2019;16:1–5. Sobuwa S, Christopher L. Emergency care education in South Africa: past, present and future. Aust J Paramed. 2019;16:1–5.
15.
go back to reference Kings M. Personal Communication with Michele Kings from the Western Cape College of Emergency Care; 2016. Kings M. Personal Communication with Michele Kings from the Western Cape College of Emergency Care; 2016.
16.
go back to reference Hughes J. SKLAR’s omega: a gaussian copula-based framework for assessing agreement. Cornell University; 2018. arXiv preprint arXiv:180302734. Hughes J. SKLAR’s omega: a gaussian copula-based framework for assessing agreement. Cornell University; 2018. arXiv preprint arXiv:180302734.
17.
go back to reference Munoz SR, Bangdiwala SI. Interpretation of kappa and B statistics measures of agreement. J Appl Stat. 1997;24(1):105–12.CrossRef Munoz SR, Bangdiwala SI. Interpretation of kappa and B statistics measures of agreement. J Appl Stat. 1997;24(1):105–12.CrossRef
18.
go back to reference American College of Surgeons Committee on Trauma. Resources for optimal care of the injured patient 2006. Chicago: American College of Surgeons; 2006. American College of Surgeons Committee on Trauma. Resources for optimal care of the injured patient 2006. Chicago: American College of Surgeons; 2006.
Metadata
Title
Validity and reliability of the South African Triage Scale in prehospital providers
Authors
Nee-Kofi Mould-Millman
Julia M. Dixon
Taylor Burkholder
Jennifer L. Pigoga
Michael Lee
Shaheem de Vries
Kubendhren Moodley
Maxene Meier
Kathryn Colborn
Chandni Patel
Lee A. Wallis
Publication date
01-12-2021
Publisher
BioMed Central
Keyword
Triage
Published in
BMC Emergency Medicine / Issue 1/2021
Electronic ISSN: 1471-227X
DOI
https://doi.org/10.1186/s12873-021-00406-6

Other articles of this Issue 1/2021

BMC Emergency Medicine 1/2021 Go to the issue