Skip to main content
Top
Published in: BMC Emergency Medicine 1/2009

Open Access 01-12-2009 | Research article

Evaluation of an algorithm for estimating a patient's life threat risk from an ambulance call

Authors: Kenji Ohshige, Chihiro Kawakami, Shunsaku Mizushima, Yoshihiro Moriwaki, Noriyuki Suzuki

Published in: BMC Emergency Medicine | Issue 1/2009

Login to get access

Abstract

Background

Utilizing a computer algorithm, information from calls to an ambulance service was used to calculate the risk of patients being in a life-threatening condition (life threat risk), at the time of the call. If the estimated life threat risk was higher than 10%, the probability that a patient faced a risk of dying was recognized as very high and categorized as category A+. The present study aimed to review the accuracy of the algorithm.

Methods

Data collected for six months from the Yokohama new emergency system was used. In the system, emergency call workers interviewed ambulance callers to obtain information necessary to assess triage, which included consciousness level, breathing status, walking ability, position, and complexion. An emergency patient's life threat risk was then estimated by a computer algorithm applying logistic models. This study compared the estimated life threat risk occurring at the time of the emergency call to the patients' state or severity of condition, i.e. death confirmed at the scene by ambulance crews, resulted in death at emergency departments, life-threatening condition with occurrence of cardiac and/or pulmonary arrest (CPA), life-threatening condition without CPA, serious but not life-threatening condition, moderate condition, and mild condition. The sensitivity, specificity, predictive values, and likelihood ratios of the algorithm for categorizing A+ were calculated.

Results

The number of emergency dispatches over the six months was 73,992. Triage assessment was conducted for 68,692 of these calls. The study targets account for 88.8% of patients who were involved in triage calls. There were 2,349 cases where the patient had died or had suffered CPA. The sensitivity, specificity, positive predictive value, negative predictive value, positive likelihood ratio and negative likelihood ratio of the algorithm at predicting cases that would result in a death or CPA were 80.2% (95% confidence interval: 78.6% - 81.8%), 96.0% (95.8% - 96.1%), 42.6% (41.1% - 44.0%), 99.2% (99.2% - 99.3%), 19.9 (18.8 - 21.1), and 0.21 (0.19 - 0.22), respectively.

Conclusion

A patient's life threat risk was quantitatively assessed at the moment of the emergency call with a moderate level of accuracy.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wrigley H, George S, Smith H, Snooks H, Glasper A, Thomas E: Trends in demand for emergency ambulance services in Wiltshire over nine years: observational study. BMJ. 2002, 324: 646-647. 10.1136/bmj.324.7338.646.CrossRefPubMedPubMedCentral Wrigley H, George S, Smith H, Snooks H, Glasper A, Thomas E: Trends in demand for emergency ambulance services in Wiltshire over nine years: observational study. BMJ. 2002, 324: 646-647. 10.1136/bmj.324.7338.646.CrossRefPubMedPubMedCentral
2.
go back to reference Nawar EW, Niska RW, Xu J: National Hospital Ambulatory Medical Care Survey: 2005 emergency department summary. Adv Data. 2007, 29: 1-32. Nawar EW, Niska RW, Xu J: National Hospital Ambulatory Medical Care Survey: 2005 emergency department summary. Adv Data. 2007, 29: 1-32.
3.
go back to reference Lambe S, Washington DL, Fink A, Herbst K, Liu H, Fosse JS, Asch SM: Trends in the use and capacity of California's emergency departments, 1990-1999. Ann Emerg Med. 2002, 39: 389-396. 10.1067/mem.2002.122433.CrossRefPubMed Lambe S, Washington DL, Fink A, Herbst K, Liu H, Fosse JS, Asch SM: Trends in the use and capacity of California's emergency departments, 1990-1999. Ann Emerg Med. 2002, 39: 389-396. 10.1067/mem.2002.122433.CrossRefPubMed
4.
go back to reference Benger JR, Jones V: Why are we here? A study of patient actions prior to emergency hospital admission. Emerg Med J. 2008, 25: 424-427. 10.1136/emj.2007.050856.CrossRefPubMed Benger JR, Jones V: Why are we here? A study of patient actions prior to emergency hospital admission. Emerg Med J. 2008, 25: 424-427. 10.1136/emj.2007.050856.CrossRefPubMed
5.
go back to reference Yang NP, Lee YH, Lin CH, Chung YC, Chen WJ, Chou P: Utilization of and direct expenditure for emergency medical care in Taiwan: a population-based descriptive study. J Epidemiol. 2009, 19: 41-48. 10.2188/jea.JE20080042.CrossRefPubMedPubMedCentral Yang NP, Lee YH, Lin CH, Chung YC, Chen WJ, Chou P: Utilization of and direct expenditure for emergency medical care in Taiwan: a population-based descriptive study. J Epidemiol. 2009, 19: 41-48. 10.2188/jea.JE20080042.CrossRefPubMedPubMedCentral
6.
go back to reference Kawakami C, Ohshige K, Kubota K, Tochikubo O: Influence of socioeconomic factors on medically unnecessary ambulance calls. BMC Health Services Research. 2007, 7: 120-10.1186/1472-6963-7-120. doi: 10.1186/1472-6963/7/120CrossRefPubMedPubMedCentral Kawakami C, Ohshige K, Kubota K, Tochikubo O: Influence of socioeconomic factors on medically unnecessary ambulance calls. BMC Health Services Research. 2007, 7: 120-10.1186/1472-6963-7-120. doi: 10.1186/1472-6963/7/120CrossRefPubMedPubMedCentral
7.
go back to reference Larsen MP, Eisenburg MS, Cummins RO, Hallstrom AP: Predicting survival from out-of-hospital cardiac arrest: a graphic model. Ann Emerg Med. 1993, 22: 1652-1658. 10.1016/S0196-0644(05)81302-2.CrossRefPubMed Larsen MP, Eisenburg MS, Cummins RO, Hallstrom AP: Predicting survival from out-of-hospital cardiac arrest: a graphic model. Ann Emerg Med. 1993, 22: 1652-1658. 10.1016/S0196-0644(05)81302-2.CrossRefPubMed
8.
go back to reference Pell JP, Sirel JM, Marsden AK, Ford I, Cobbe SM: Effect of reducing ambulance response times on deaths from out of hospital cardiac arrest: cohort study. BMJ. 2001, 322: 1385-1388. 10.1136/bmj.322.7299.1385.CrossRefPubMedPubMedCentral Pell JP, Sirel JM, Marsden AK, Ford I, Cobbe SM: Effect of reducing ambulance response times on deaths from out of hospital cardiac arrest: cohort study. BMJ. 2001, 322: 1385-1388. 10.1136/bmj.322.7299.1385.CrossRefPubMedPubMedCentral
9.
go back to reference Moore W, Kee F, Evans AE, McCrum-Gardner EE, Morrison C, Tunstall-Pedoe H: Pre-hospital coronary care and coronary fatality in the Belfast and Glasgow MONICA populations. Int J Epidemiol. 2005, 34: 422-430. 10.1093/ije/dyh377.CrossRefPubMed Moore W, Kee F, Evans AE, McCrum-Gardner EE, Morrison C, Tunstall-Pedoe H: Pre-hospital coronary care and coronary fatality in the Belfast and Glasgow MONICA populations. Int J Epidemiol. 2005, 34: 422-430. 10.1093/ije/dyh377.CrossRefPubMed
10.
go back to reference Ohshige K, Shimazaki S, Hirasawa H, Nakamura M, Kin H, Fujii C, Okuchi K, Yamamoto Y, Akashi K, Takeda J, Hanyuda T, Tochikubo O: Evaluation of out-of-hospital cardiopulmonary resuscitation with resuscitative drugs: a prospective comparative study in Japan. Resuscitation. 2005, 66: 53-61. 10.1016/j.resuscitation.2004.10.019.CrossRefPubMed Ohshige K, Shimazaki S, Hirasawa H, Nakamura M, Kin H, Fujii C, Okuchi K, Yamamoto Y, Akashi K, Takeda J, Hanyuda T, Tochikubo O: Evaluation of out-of-hospital cardiopulmonary resuscitation with resuscitative drugs: a prospective comparative study in Japan. Resuscitation. 2005, 66: 53-61. 10.1016/j.resuscitation.2004.10.019.CrossRefPubMed
11.
go back to reference Tanigawa K, Tanaka K: Emergency medical service systems in Japan: past, present, and future. Resuscitation. 2006, 69: 365-370. 10.1016/j.resuscitation.2006.04.001.CrossRefPubMed Tanigawa K, Tanaka K: Emergency medical service systems in Japan: past, present, and future. Resuscitation. 2006, 69: 365-370. 10.1016/j.resuscitation.2006.04.001.CrossRefPubMed
12.
go back to reference Ohshige K: Reduction in ambulance transports during a public awareness campaign for appropriate ambulance use. Acad Emerg Med. 2008, 15: 289-293. 10.1111/j.1553-2712.2008.00044.x.CrossRefPubMed Ohshige K: Reduction in ambulance transports during a public awareness campaign for appropriate ambulance use. Acad Emerg Med. 2008, 15: 289-293. 10.1111/j.1553-2712.2008.00044.x.CrossRefPubMed
13.
go back to reference Harvey L, Woollard M: Outcome of patients identified as dead (beyond resuscitation) at the point of the emergency call. Emerg Med J. 2004, 21: 367-369. 10.1136/emj.2002.002410.CrossRefPubMedPubMedCentral Harvey L, Woollard M: Outcome of patients identified as dead (beyond resuscitation) at the point of the emergency call. Emerg Med J. 2004, 21: 367-369. 10.1136/emj.2002.002410.CrossRefPubMedPubMedCentral
14.
go back to reference Ohshige K: Triage algorithm in Yokohama dispatch system. Kyu-kyu Iryo Journal. 2007, 15: 75-80. (in Japanese) Ohshige K: Triage algorithm in Yokohama dispatch system. Kyu-kyu Iryo Journal. 2007, 15: 75-80. (in Japanese)
15.
go back to reference Greene WH: Models for discrete choice. Econometric Analysis. Upper Saddle River. 2003, New Jersey: Prentice Hall, 663-755. 5 Greene WH: Models for discrete choice. Econometric Analysis. Upper Saddle River. 2003, New Jersey: Prentice Hall, 663-755. 5
16.
go back to reference Steg PG, Bonnefoy E, Chabaud S, Lapostolle F, Dubien PY, Cristofini P, Leizorovicz A, Touboul P: Impact of time to treatment on mortality after prehospital fibrinolysis or primary angioplasty: data from the CAPTIM randomized clinical trial. Circulation. 2003, 108: 2851-56. 10.1161/01.CIR.0000103122.10021.F2.CrossRefPubMed Steg PG, Bonnefoy E, Chabaud S, Lapostolle F, Dubien PY, Cristofini P, Leizorovicz A, Touboul P: Impact of time to treatment on mortality after prehospital fibrinolysis or primary angioplasty: data from the CAPTIM randomized clinical trial. Circulation. 2003, 108: 2851-56. 10.1161/01.CIR.0000103122.10021.F2.CrossRefPubMed
17.
go back to reference Schmidt TA, Cone DC, Mann NC: Criteria currently used to evaluate dispatch triage systems: where do they leave us?. Prehosp Emerg Care. 2004, 8: 126-129. 10.1016/j.prehos.2003.12.003.PubMed Schmidt TA, Cone DC, Mann NC: Criteria currently used to evaluate dispatch triage systems: where do they leave us?. Prehosp Emerg Care. 2004, 8: 126-129. 10.1016/j.prehos.2003.12.003.PubMed
18.
go back to reference Shah MN, Bishop P, Lerner EB, Fairbanks RJ, Davis EA: Validation of using EMS dispatch codes to identify low-acuity patients. Prehosp Emerg Care. 2005, 9: 24-31. 10.1080/10903120590891651.CrossRefPubMed Shah MN, Bishop P, Lerner EB, Fairbanks RJ, Davis EA: Validation of using EMS dispatch codes to identify low-acuity patients. Prehosp Emerg Care. 2005, 9: 24-31. 10.1080/10903120590891651.CrossRefPubMed
19.
go back to reference Marks PJ, Daniel TD, Afolabi O, Spiers G, Nguyen-Van-Tam JS: Emergency (999) calls to the ambulance service that do not result in the patient being transported to hospital: an epidemiological study. Emerg Med J. 2002, 19: 449-452. 10.1136/emj.19.5.449.CrossRefPubMedPubMedCentral Marks PJ, Daniel TD, Afolabi O, Spiers G, Nguyen-Van-Tam JS: Emergency (999) calls to the ambulance service that do not result in the patient being transported to hospital: an epidemiological study. Emerg Med J. 2002, 19: 449-452. 10.1136/emj.19.5.449.CrossRefPubMedPubMedCentral
20.
go back to reference Heward A, Damiani M, Hartley-Sharpe C: Does the use of the Advanced Medical Priority Dispatch System affect cardiac arrest detection?. Emerg Med J. 2004, 21: 115-118. 10.1136/emj.2003.006940.CrossRefPubMedPubMedCentral Heward A, Damiani M, Hartley-Sharpe C: Does the use of the Advanced Medical Priority Dispatch System affect cardiac arrest detection?. Emerg Med J. 2004, 21: 115-118. 10.1136/emj.2003.006940.CrossRefPubMedPubMedCentral
21.
go back to reference Deakin CD, Sherwood DM, Smith A, Cassidy M: Does telephone triage of emergency (999) calls using Advanced Medical Priority Dispatch (AMPDS) with Department of Health (DH) call prioritisation effectively identify patients with an acute coronary syndrome? An audit of 42,657 emergency calls to Hampshire Ambulance Service NHS Trust. Emerg Med J. 2006, 23: 232-235. 10.1136/emj.2004.022962.CrossRefPubMedPubMedCentral Deakin CD, Sherwood DM, Smith A, Cassidy M: Does telephone triage of emergency (999) calls using Advanced Medical Priority Dispatch (AMPDS) with Department of Health (DH) call prioritisation effectively identify patients with an acute coronary syndrome? An audit of 42,657 emergency calls to Hampshire Ambulance Service NHS Trust. Emerg Med J. 2006, 23: 232-235. 10.1136/emj.2004.022962.CrossRefPubMedPubMedCentral
22.
go back to reference Clawson J, Olola CH, Heward A, Scott G, Patterson B: Accuracy of emergency medical dispatchers' subjective ability to identify when higher dispatch levels are warranted over a Medical Priority Dispatch System automated protocol's recommended coding based on paramedic outcome data. Emerg Med J. 2007, 24: 560-563. 10.1136/emj.2007.047928.CrossRefPubMedPubMedCentral Clawson J, Olola CH, Heward A, Scott G, Patterson B: Accuracy of emergency medical dispatchers' subjective ability to identify when higher dispatch levels are warranted over a Medical Priority Dispatch System automated protocol's recommended coding based on paramedic outcome data. Emerg Med J. 2007, 24: 560-563. 10.1136/emj.2007.047928.CrossRefPubMedPubMedCentral
23.
go back to reference Feldman MJ, Verbeek PR, Lyons DG, Chad SJ, Craig AM, Schwartz B: Comparison of the medical priority dispatch system to an out-of-hospital patient acuity score. Acad Emerg Med. 2006, 13: 954-960. 10.1111/j.1553-2712.2006.tb00341.x.CrossRefPubMed Feldman MJ, Verbeek PR, Lyons DG, Chad SJ, Craig AM, Schwartz B: Comparison of the medical priority dispatch system to an out-of-hospital patient acuity score. Acad Emerg Med. 2006, 13: 954-960. 10.1111/j.1553-2712.2006.tb00341.x.CrossRefPubMed
24.
go back to reference Kuisma M, Holmström P, Repo J, Määttä T, Nousila-Wiik M, Boyd J: Prehospital mortality in an EMS system using medical priority dispatching: a community based cohort study. Resuscitation. 2004, 61: 297-302. 10.1016/j.resuscitation.2004.01.008.CrossRefPubMed Kuisma M, Holmström P, Repo J, Määttä T, Nousila-Wiik M, Boyd J: Prehospital mortality in an EMS system using medical priority dispatching: a community based cohort study. Resuscitation. 2004, 61: 297-302. 10.1016/j.resuscitation.2004.01.008.CrossRefPubMed
25.
go back to reference Shah MN, Bishop P, Lerner EB, Czapranski T, Davis EA: Derivation of emergency medical services dispatch codes associated with low-acuity patients. Prehosp Emerg Care. 2003, 7: 434-439. 10.1080/312703002132.CrossRefPubMed Shah MN, Bishop P, Lerner EB, Czapranski T, Davis EA: Derivation of emergency medical services dispatch codes associated with low-acuity patients. Prehosp Emerg Care. 2003, 7: 434-439. 10.1080/312703002132.CrossRefPubMed
26.
go back to reference Flynn J, Archer F, Morgans A: Sensitivity and specificity of the medical priority dispatch system in detecting cardiac arrest emergency calls in Melbourne. Prehosp Disaster Med. 2006, 21: 72-76.PubMed Flynn J, Archer F, Morgans A: Sensitivity and specificity of the medical priority dispatch system in detecting cardiac arrest emergency calls in Melbourne. Prehosp Disaster Med. 2006, 21: 72-76.PubMed
28.
go back to reference Kahn CA, Schultz CH, Miller KT, Anderson CL: Does START triage work? An outcomes assessment after a disaster. Ann Emerg Med. 2009, 54: 424-430. 10.1016/j.annemergmed.2008.12.035.CrossRefPubMed Kahn CA, Schultz CH, Miller KT, Anderson CL: Does START triage work? An outcomes assessment after a disaster. Ann Emerg Med. 2009, 54: 424-430. 10.1016/j.annemergmed.2008.12.035.CrossRefPubMed
Metadata
Title
Evaluation of an algorithm for estimating a patient's life threat risk from an ambulance call
Authors
Kenji Ohshige
Chihiro Kawakami
Shunsaku Mizushima
Yoshihiro Moriwaki
Noriyuki Suzuki
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Emergency Medicine / Issue 1/2009
Electronic ISSN: 1471-227X
DOI
https://doi.org/10.1186/1471-227X-9-21

Other articles of this Issue 1/2009

BMC Emergency Medicine 1/2009 Go to the issue