Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Intoxication | Research

Comparison of decision tree with common machine learning models for prediction of biguanide and sulfonylurea poisoning in the United States: an analysis of the National Poison Data System

Authors: Omid Mehrpour, Farhad Saeedi, Samaneh Nakhaee, Farbod Tavakkoli Khomeini, Ali Hadianfar, Alireza Amirabadizadeh, Christopher Hoyte

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Biguanides and sulfonylurea are two classes of anti-diabetic medications that have commonly been prescribed all around the world. Diagnosis of biguanide and sulfonylurea exposures is based on history taking and physical examination; thus, physicians might misdiagnose these two different clinical settings. We aimed to conduct a study to develop a model based on decision tree analysis to help physicians better diagnose these poisoning cases.

Methods

The National Poison Data System was used for this six-year retrospective cohort study.The decision tree model, common machine learning models multi layers perceptron, stochastic gradient descent (SGD), Adaboosting classiefier, linear support vector machine and ensembling methods including bagging, voting and stacking methods were used. The confusion matrix, precision, recall, specificity, f1-score, and accuracy were reported to evaluate the model’s performance.

Results

Of 6183 participants, 3336 patients (54.0%) were identified as biguanides exposures, and the remaining were those with sulfonylureas exposures. The decision tree model showed that the most important clinical findings defining biguanide and sulfonylurea exposures were hypoglycemia, abdominal pain, acidosis, diaphoresis, tremor, vomiting, diarrhea, age, and reasons for exposure. The specificity, precision, recall, f1-score, and accuracy of all models were greater than 86%, 89%, 88%, and 88%, respectively. The lowest values belong to SGD model. The decision tree model has a sensitivity (recall) of 93.3%, specificity of 92.8%, precision of 93.4%, f1_score of 93.3%, and accuracy of 93.3%.

Conclusion

Our results indicated that machine learning methods including decision tree and ensembling methods provide a precise prediction model to diagnose biguanides and sulfonylureas exposure.
Literature
1.
go back to reference Raval AD, Vyas A. National trends in diabetes medication use in the United States: 2008 to 2015. J Pharm Pract. 2020;33(4):433–42.PubMedCrossRef Raval AD, Vyas A. National trends in diabetes medication use in the United States: 2008 to 2015. J Pharm Pract. 2020;33(4):433–42.PubMedCrossRef
2.
go back to reference Harrigan RA, Nathan MS, Beattie P. Oral agents for the treatment of type 2 diabetes mellitus: pharmacology, toxicity, and treatment. Ann Emerg Med. 2001;38(1):68–78.PubMedCrossRef Harrigan RA, Nathan MS, Beattie P. Oral agents for the treatment of type 2 diabetes mellitus: pharmacology, toxicity, and treatment. Ann Emerg Med. 2001;38(1):68–78.PubMedCrossRef
3.
4.
go back to reference Litovitz TL, et al. 2001 Annual report of the American Association of Poison Control Centers Toxic Exposure Surveillance System. Am J Emerg Med. 2002;20(5):391–452.PubMedCrossRef Litovitz TL, et al. 2001 Annual report of the American Association of Poison Control Centers Toxic Exposure Surveillance System. Am J Emerg Med. 2002;20(5):391–452.PubMedCrossRef
5.
go back to reference Watson WA, et al. 2004 Annual report of the American Association of Poison Control Centers Toxic Exposure Surveillance System. Am J Emerg Med. 2005;23(5):589–666.PubMedCrossRef Watson WA, et al. 2004 Annual report of the American Association of Poison Control Centers Toxic Exposure Surveillance System. Am J Emerg Med. 2005;23(5):589–666.PubMedCrossRef
6.
go back to reference Spiller HA, Sawyer TS. Toxicology of oral antidiabetic medications. Am J Health-System Pharm. 2006;63(10):929–38.CrossRef Spiller HA, Sawyer TS. Toxicology of oral antidiabetic medications. Am J Health-System Pharm. 2006;63(10):929–38.CrossRef
7.
go back to reference Mowry JB, et al. 2015 Annual report of the American Association of Poison Control Centers’ National Poison Data System (NPDS): 33rd annual report. Clin Toxicol (Phila). 2016;54(10):924–1109.PubMedCrossRef Mowry JB, et al. 2015 Annual report of the American Association of Poison Control Centers’ National Poison Data System (NPDS): 33rd annual report. Clin Toxicol (Phila). 2016;54(10):924–1109.PubMedCrossRef
8.
go back to reference Bronstein AC, et al. 2007 annual report of the American Association of Poison Control Centers’ National Poison Data System (NPDS): 25th annual report. Clin Toxicol. 2008;46(10):927–1057.CrossRef Bronstein AC, et al. 2007 annual report of the American Association of Poison Control Centers’ National Poison Data System (NPDS): 25th annual report. Clin Toxicol. 2008;46(10):927–1057.CrossRef
9.
go back to reference Stevens A, et al. Metformin overdose: a serious iatrogenic complication—western France poison control centre data analysis. Basic Clin Pharmacol Toxicol. 2019;125(5):466–73.PubMedCrossRef Stevens A, et al. Metformin overdose: a serious iatrogenic complication—western France poison control centre data analysis. Basic Clin Pharmacol Toxicol. 2019;125(5):466–73.PubMedCrossRef
10.
11.
go back to reference Spiller HA, Quadrani DA. Toxic effects from metformin exposure. Ann Pharmacother. 2004;38(5):776–80.PubMedCrossRef Spiller HA, Quadrani DA. Toxic effects from metformin exposure. Ann Pharmacother. 2004;38(5):776–80.PubMedCrossRef
12.
go back to reference Leese GP, et al. Frequency of severe hypoglycemia requiring emergency treatment in type 1 and type 2 diabetes. A population-based study of health service resource use. Diabetes Care. 2003;26(4):1176–80.PubMedCrossRef Leese GP, et al. Frequency of severe hypoglycemia requiring emergency treatment in type 1 and type 2 diabetes. A population-based study of health service resource use. Diabetes Care. 2003;26(4):1176–80.PubMedCrossRef
13.
go back to reference Spiller HA, Sawyer TS. Toxicology of oral antidiabetic medications. Am J Health Syst Pharm. 2006;63(10):929–38.PubMedCrossRef Spiller HA, Sawyer TS. Toxicology of oral antidiabetic medications. Am J Health Syst Pharm. 2006;63(10):929–38.PubMedCrossRef
14.
go back to reference Rowden AK, Fasano CJ. Emergency management of oral hypoglycemic drug toxicity. Emerg Med Clin N Am. 2007;25(2):347–56.CrossRef Rowden AK, Fasano CJ. Emergency management of oral hypoglycemic drug toxicity. Emerg Med Clin N Am. 2007;25(2):347–56.CrossRef
15.
go back to reference Lada P, Idrees U. Toxicity of oral agents used to treat diabetes. J Pharm Pract. 2005;18(3):145–56.CrossRef Lada P, Idrees U. Toxicity of oral agents used to treat diabetes. J Pharm Pract. 2005;18(3):145–56.CrossRef
17.
go back to reference Sidey-Gibbons JA, Sidey-Gibbons CJ. Machine learning in medicine: a practical introduction. BMC Med Res Methodol. 2019;19(1):1–18.CrossRef Sidey-Gibbons JA, Sidey-Gibbons CJ. Machine learning in medicine: a practical introduction. BMC Med Res Methodol. 2019;19(1):1–18.CrossRef
18.
go back to reference Podgorelec V, et al. Decision trees: an overview and their use in medicine. J Med Syst. 2002;26(5):445–63.PubMedCrossRef Podgorelec V, et al. Decision trees: an overview and their use in medicine. J Med Syst. 2002;26(5):445–63.PubMedCrossRef
19.
go back to reference Lungu A, et al. Diagnosis of pulmonary hypertension from magnetic resonance imaging–based computational models and decision tree analysis. Pulm Circ. 2016;6(2):181–90.PubMedPubMedCentralCrossRef Lungu A, et al. Diagnosis of pulmonary hypertension from magnetic resonance imaging–based computational models and decision tree analysis. Pulm Circ. 2016;6(2):181–90.PubMedPubMedCentralCrossRef
20.
go back to reference Su Y, et al. Diagnosis of gastric cancer using decision tree classification of mass spectral data. Cancer Sci. 2007;98(1):37–43.PubMedCrossRef Su Y, et al. Diagnosis of gastric cancer using decision tree classification of mass spectral data. Cancer Sci. 2007;98(1):37–43.PubMedCrossRef
21.
go back to reference Ghiasi MM, Zendehboudi S, Mohsenipour AA. Decision tree-based diagnosis of coronary artery disease: CART model. Comput Methods Programs Biomed. 2020;192:105400.PubMedCrossRef Ghiasi MM, Zendehboudi S, Mohsenipour AA. Decision tree-based diagnosis of coronary artery disease: CART model. Comput Methods Programs Biomed. 2020;192:105400.PubMedCrossRef
22.
go back to reference Kim YH, et al. MRI-based decision tree model for diagnosis of biliary atresia. Eur Radiol. 2018;28(8):3422–31.PubMedCrossRef Kim YH, et al. MRI-based decision tree model for diagnosis of biliary atresia. Eur Radiol. 2018;28(8):3422–31.PubMedCrossRef
23.
go back to reference Amirabadizadeh A, et al. Identifying risk factors for drug use in an Iranian treatment sample: a prediction approach using decision trees. Subst Use Misuse. 2018;53(6):1030–40.PubMedCrossRef Amirabadizadeh A, et al. Identifying risk factors for drug use in an Iranian treatment sample: a prediction approach using decision trees. Subst Use Misuse. 2018;53(6):1030–40.PubMedCrossRef
24.
go back to reference Gupta B, et al. Analysis of various decision tree algorithms for classification in data mining. Int J Comput Appl. 2017;163(8):15–9. Gupta B, et al. Analysis of various decision tree algorithms for classification in data mining. Int J Comput Appl. 2017;163(8):15–9.
25.
go back to reference Long WJ, et al. A comparison of logistic regression to decision-tree induction in a medical domain. Comput Biomed Res. 1993;26(1):74–97.PubMedCrossRef Long WJ, et al. A comparison of logistic regression to decision-tree induction in a medical domain. Comput Biomed Res. 1993;26(1):74–97.PubMedCrossRef
26.
go back to reference Li YH, Jain AK. Classification of text documents. Comput J. 1998;41(8):537–46.CrossRef Li YH, Jain AK. Classification of text documents. Comput J. 1998;41(8):537–46.CrossRef
27.
go back to reference Chary M, Boyer EW, Burns MM. Diagnosis of acute poisoning using explainable artificial intelligence. Comput Biol Med. 2021;134:104469.PubMedCrossRef Chary M, Boyer EW, Burns MM. Diagnosis of acute poisoning using explainable artificial intelligence. Comput Biol Med. 2021;134:104469.PubMedCrossRef
28.
go back to reference Chary M, Burnsa M, Boyerb E. Tak: the computational toxicological machine. 39th International Congress of the European Association of Poisons Centres and clinical toxicologists (EAPCCT) 21–24 May 2019, Naples, Italy. Clin Tox. 2019;57(6):482. Chary M, Burnsa M, Boyerb E. Tak: the computational toxicological machine. 39th International Congress of the European Association of Poisons Centres and clinical toxicologists (EAPCCT) 21–24 May 2019, Naples, Italy. Clin Tox. 2019;57(6):482.
30.
go back to reference Nogee D, et al. Multiclass classification machine learning identification of common poisonings. North American congress of clinical toxicology (NACCT) abstracts 2020. Clin Toxicol. 2020;58(11):1083–4. Nogee D, et al. Multiclass classification machine learning identification of common poisonings. North American congress of clinical toxicology (NACCT) abstracts 2020. Clin Toxicol. 2020;58(11):1083–4.
31.
go back to reference Nogee D, Tomassoni A. Development of a prototype software tool to assist with toxidrome recognition. North American congress of clinical toxicology (NACCT) abstracts 2018. Clin Toxicol. 2018;56(10):1049. Nogee D, Tomassoni A. Development of a prototype software tool to assist with toxidrome recognition. North American congress of clinical toxicology (NACCT) abstracts 2018. Clin Toxicol. 2018;56(10):1049.
32.
go back to reference Sadeghian F, Saadat S, Goli S. The influences of cigarette smoking on psychomotor performance of driving: perceptual speed, 2-hand coordination. J Knowl Health Shahroud Univ Med Sci. 2017;12(3). Sadeghian F, Saadat S, Goli S. The influences of cigarette smoking on psychomotor performance of driving: perceptual speed, 2-hand coordination. J Knowl Health Shahroud Univ Med Sci. 2017;12(3).
33.
go back to reference Benenson E, “Diagnose to target” in the setting of decision trees, In: Syndrome-based approach to diagnosis: a practical guide, London: Springer-Verlag; 2013. pp. 59–106. Benenson E, “Diagnose to target” in the setting of decision trees, In: Syndrome-based approach to diagnosis: a practical guide, London: Springer-Verlag;  2013. pp. 59–106.
35.
go back to reference Tayefi M, et al. hs-CRP is strongly associated with coronary heart disease (CHD): a data mining approach using decision tree algorithm. Comput Methods Programs Biomed. 2017;141:105–9.PubMedCrossRef Tayefi M, et al. hs-CRP is strongly associated with coronary heart disease (CHD): a data mining approach using decision tree algorithm. Comput Methods Programs Biomed. 2017;141:105–9.PubMedCrossRef
36.
go back to reference Kammerer JS, et al. Tuberculosis transmission in nontraditional settings: a decision-tree approach. Am J Prev Med. 2005;28(2):201–7.PubMedCrossRef Kammerer JS, et al. Tuberculosis transmission in nontraditional settings: a decision-tree approach. Am J Prev Med. 2005;28(2):201–7.PubMedCrossRef
37.
go back to reference Amirabadizadeh A, Nakhaee S, Mehrpour O. Risk assessment of elevated blood lead concentrations in the adult population using a decision tree approach. Drug Chem Toxicol. 2022;45(2):878–85PubMedCrossRef Amirabadizadeh A, Nakhaee S, Mehrpour O. Risk assessment of elevated blood lead concentrations in the adult population using a decision tree approach. Drug Chem Toxicol. 2022;45(2):878–85PubMedCrossRef
38.
go back to reference Amirabadizadeh A, et al. Identifying risk factors for drug use in an Iranian treatment sample: a prediction approach using decision trees. Subst Use Misuse. 2018;53(6):1030–40.PubMedCrossRef Amirabadizadeh A, et al. Identifying risk factors for drug use in an Iranian treatment sample: a prediction approach using decision trees. Subst Use Misuse. 2018;53(6):1030–40.PubMedCrossRef
39.
go back to reference Zhang Z. Decision tree modeling using R. Ann Transl Med. 2016;4(15). Zhang Z. Decision tree modeling using R. Ann Transl Med. 2016;4(15).
40.
go back to reference Amirabadizadeh A, Nakhaee S, Mehrpour O. Risk assessment of elevated blood lead concentrations in the adult population using a decision tree approach. Drug Chem Toxicol. 2020;1–8. Amirabadizadeh A, Nakhaee S, Mehrpour O. Risk assessment of elevated blood lead concentrations in the adult population using a decision tree approach. Drug Chem Toxicol. 2020;1–8.
41.
go back to reference Walsh SL, et al. Deep learning for classifying fibrotic lung disease on high-resolution computed tomography: a case-cohort study. Lancet Respir Med. 2018;6(11):837–45.PubMedCrossRef Walsh SL, et al. Deep learning for classifying fibrotic lung disease on high-resolution computed tomography: a case-cohort study. Lancet Respir Med. 2018;6(11):837–45.PubMedCrossRef
43.
go back to reference Phillips M, et al. Assessment of accuracy of an artificial intelligence algorithm to detect melanoma in images of skin lesions. JAMA Netw Open. 2019;2(10):e1913436-6.PubMedPubMedCentralCrossRef Phillips M, et al. Assessment of accuracy of an artificial intelligence algorithm to detect melanoma in images of skin lesions. JAMA Netw Open. 2019;2(10):e1913436-6.PubMedPubMedCentralCrossRef
44.
go back to reference Topalovic M, et al. Artificial intelligence outperforms pulmonologists in the interpretation of pulmonary function tests. Eur Respir J. 2019;53(4). Topalovic M, et al. Artificial intelligence outperforms pulmonologists in the interpretation of pulmonary function tests. Eur Respir J. 2019;53(4).
45.
go back to reference Balasubramaniam V. Artificial intelligence algorithm with SVM classification using dermascopic images for melanoma diagnosis. J Artif Intell Capsul Netw. 2021;3(1):34–42.CrossRef Balasubramaniam V. Artificial intelligence algorithm with SVM classification using dermascopic images for melanoma diagnosis. J Artif Intell Capsul Netw. 2021;3(1):34–42.CrossRef
46.
go back to reference Ouchi K, et al. Machine learning to predict, detect, and intervene older adults vulnerable for adverse drug events in the emergency department. J Med Toxicol. 2018;14(3):248–52.PubMedPubMedCentralCrossRef Ouchi K, et al. Machine learning to predict, detect, and intervene older adults vulnerable for adverse drug events in the emergency department. J Med Toxicol. 2018;14(3):248–52.PubMedPubMedCentralCrossRef
47.
go back to reference Mekov E, Miravitlles M, Petkov R. Artificial intelligence and machine learning in respiratory medicine. Expert Rev Respir Med. 2020;14(6):559–64.PubMedCrossRef Mekov E, Miravitlles M, Petkov R. Artificial intelligence and machine learning in respiratory medicine. Expert Rev Respir Med. 2020;14(6):559–64.PubMedCrossRef
48.
49.
go back to reference Bron M, et al. Hypoglycemia, treatment discontinuation, and costs in patients with type 2 diabetes mellitus on oral antidiabetic drugs. Postgrad Med. 2012;124(1):124–32.PubMedCrossRef Bron M, et al. Hypoglycemia, treatment discontinuation, and costs in patients with type 2 diabetes mellitus on oral antidiabetic drugs. Postgrad Med. 2012;124(1):124–32.PubMedCrossRef
50.
go back to reference Kwong SC, Brubacher J. Phenformin and lactic acidosis: a case report and review. J Emerg Med. 1998;16(6):881–6.PubMedCrossRef Kwong SC, Brubacher J. Phenformin and lactic acidosis: a case report and review. J Emerg Med. 1998;16(6):881–6.PubMedCrossRef
52.
go back to reference Barrella N, Eisenberg B, Simpson SN. Hypoglycemia and severe lactic acidosis in a dog following metformin exposure. Clin case Rep. 2017;5(12):2097–104.PubMedPubMedCentralCrossRef Barrella N, Eisenberg B, Simpson SN. Hypoglycemia and severe lactic acidosis in a dog following metformin exposure. Clin case Rep. 2017;5(12):2097–104.PubMedPubMedCentralCrossRef
53.
go back to reference Broichhagen J, et al. Optical control of insulin release using a photoswitchable sulfonylurea. Nat Commun. 2014;5(1):5116.PubMedCrossRef Broichhagen J, et al. Optical control of insulin release using a photoswitchable sulfonylurea. Nat Commun. 2014;5(1):5116.PubMedCrossRef
54.
go back to reference Seidowsky A, et al. Metformin-associated lactic acidosis: a prognostic and therapeutic study. Crit Care Med. 2009. 37(7). Seidowsky A, et al. Metformin-associated lactic acidosis: a prognostic and therapeutic study. Crit Care Med. 2009. 37(7).
55.
go back to reference Hur KY, Lee M-S. New mechanisms of metformin action: focusing on mitochondria and the gut. J Diabetes Invest. 2015;6(6):600–9.CrossRef Hur KY, Lee M-S. New mechanisms of metformin action: focusing on mitochondria and the gut. J Diabetes Invest. 2015;6(6):600–9.CrossRef
58.
go back to reference Galea M, et al. Severe lactic acidosis and rhabdomyolysis following metformin and ramipril overdose. Br J Anaesth. 2007;98(2):213–5.PubMedCrossRef Galea M, et al. Severe lactic acidosis and rhabdomyolysis following metformin and ramipril overdose. Br J Anaesth. 2007;98(2):213–5.PubMedCrossRef
59.
go back to reference Bebarta VS, Pead J, Varney SM. Lacticemia after acute overdose of metformin in an adolescent managed without intravenous sodium bicarbonate or extracorporeal therapy. Pediatr Emerg Care. 2015;31(8):589–90.PubMedCrossRef Bebarta VS, Pead J, Varney SM. Lacticemia after acute overdose of metformin in an adolescent managed without intravenous sodium bicarbonate or extracorporeal therapy. Pediatr Emerg Care. 2015;31(8):589–90.PubMedCrossRef
60.
go back to reference Fatima M, Sadeeqa S, Nazir S. Metformin and its gastrointestinal problems: a review. Biomed Res. 2018;29:2285–9.CrossRef Fatima M, Sadeeqa S, Nazir S. Metformin and its gastrointestinal problems: a review. Biomed Res. 2018;29:2285–9.CrossRef
61.
go back to reference Bonnet F, Scheen A. Underst overcoming metformin gastrointest intolerance. Diabetes Obes Metab. 2017;19(4):473–81.PubMedCrossRef Bonnet F, Scheen A. Underst overcoming metformin gastrointest intolerance. Diabetes Obes Metab. 2017;19(4):473–81.PubMedCrossRef
Metadata
Title
Comparison of decision tree with common machine learning models for prediction of biguanide and sulfonylurea poisoning in the United States: an analysis of the National Poison Data System
Authors
Omid Mehrpour
Farhad Saeedi
Samaneh Nakhaee
Farbod Tavakkoli Khomeini
Ali Hadianfar
Alireza Amirabadizadeh
Christopher Hoyte
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-022-02095-y

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue