Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2018

Open Access 01-12-2018 | Research article

Development of a personalized diagnostic model for kidney stone disease tailored to acute care by integrating large clinical, demographics and laboratory data: the diagnostic acute care algorithm - kidney stones (DACA-KS)

Authors: Zhaoyi Chen, Victoria Y. Bird, Rupam Ruchi, Mark S. Segal, Jiang Bian, Saeed R. Khan, Marie-Carmelle Elie, Mattia Prosperi

Published in: BMC Medical Informatics and Decision Making | Issue 1/2018

Login to get access

Abstract

Background

Kidney stone (KS) disease has high, increasing prevalence in the United States and poses a massive economic burden. Diagnostics algorithms of KS only use a few variables with a limited sensitivity and specificity. In this study, we tested a big data approach to infer and validate a ‘multi-domain’ personalized diagnostic acute care algorithm for KS (DACA-KS), merging demographic, vital signs, clinical, and laboratory information.

Methods

We utilized a large, single-center database of patients admitted to acute care units in a large tertiary care hospital. Patients diagnosed with KS were compared to groups of patients with acute abdominal/flank/groin pain, genitourinary diseases, and other conditions. We analyzed multiple information domains (several thousands of variables) using a collection of statistical and machine learning models with feature selectors. We compared sensitivity, specificity and area under the receiver operating characteristic (AUROC) of our approach with the STONE score, using cross-validation.

Results

Thirty eight thousand five hundred and ninety-seven distinct adult patients were admitted to critical care between 2001 and 2012, of which 217 were diagnosed with KS, and 7446 with acute pain (non-KS). The multi-domain approach using logistic regression yielded an AUROC of 0.86 and a sensitivity/specificity of 0.81/0.82 in cross-validation. Increase in performance was obtained by fitting a super-learner, at the price of lower interpretability. We discussed in detail comorbidity and lab marker variables independently associated with KS (e.g. blood chloride, candidiasis, sleep disorders).

Conclusions

Although external validation is warranted, DACA-KS could be integrated into electronic health systems; the algorithm has the potential used as an effective tool to help nurses and healthcare personnel during triage or clinicians making a diagnosis, streamlining patients’ management in acute care.
Literature
1.
go back to reference Scales CD Jr, Smith AC, Hanley JM, Saigal CS. urologic diseases in America project. Prevalence of kidney stones in the United States. Eur Urol. 2012 Jul;62(1):160–5.CrossRefPubMedPubMedCentral Scales CD Jr, Smith AC, Hanley JM, Saigal CS. urologic diseases in America project. Prevalence of kidney stones in the United States. Eur Urol. 2012 Jul;62(1):160–5.CrossRefPubMedPubMedCentral
2.
go back to reference Antonelli JA, Maalouf NM, Pearle MS, Lotan Y. Use of the National Health and nutrition examination survey to calculate the impact of obesity and diabetes on cost and prevalence of urolithiasis in 2030. Eur Urol. 2014 Oct;66(4):724–9.CrossRefPubMedPubMedCentral Antonelli JA, Maalouf NM, Pearle MS, Lotan Y. Use of the National Health and nutrition examination survey to calculate the impact of obesity and diabetes on cost and prevalence of urolithiasis in 2030. Eur Urol. 2014 Oct;66(4):724–9.CrossRefPubMedPubMedCentral
4.
go back to reference Rule AD, Bergstralh EJ, Melton LJ 3rd, Li X, Weaver AL, Lieske JC. Kidney stones and the risk for chronic kidney disease. Clin J Am Soc Nephrol. 2009 Apr;4(4):804–11.CrossRefPubMedPubMedCentral Rule AD, Bergstralh EJ, Melton LJ 3rd, Li X, Weaver AL, Lieske JC. Kidney stones and the risk for chronic kidney disease. Clin J Am Soc Nephrol. 2009 Apr;4(4):804–11.CrossRefPubMedPubMedCentral
5.
go back to reference Graham A, Luber S, Wolfson AB. Urolithiasis in the emergency department. Emerg Med Clin North Am. 2011 Aug;29(3):519–38.CrossRefPubMed Graham A, Luber S, Wolfson AB. Urolithiasis in the emergency department. Emerg Med Clin North Am. 2011 Aug;29(3):519–38.CrossRefPubMed
6.
7.
go back to reference Moore CL, Bomann S, Daniels B, Luty S, Molinaro A, Singh D, Gross CP. Derivation and validation of a clinical prediction rule for uncomplicated ureteral STONE--the STONE score: retrospective and prospective observational cohort studies. BMJ. 2014 Mar 26;348:g2191.CrossRefPubMedPubMedCentral Moore CL, Bomann S, Daniels B, Luty S, Molinaro A, Singh D, Gross CP. Derivation and validation of a clinical prediction rule for uncomplicated ureteral STONE--the STONE score: retrospective and prospective observational cohort studies. BMJ. 2014 Mar 26;348:g2191.CrossRefPubMedPubMedCentral
8.
go back to reference Hernandez N, Song Y, Noble VE, Eisner BH. Predicting ureteral stones in emergency department patients with flank pain: an external validation of the STONE score. World J Urol. 2016 Oct;34(10):1443–6.CrossRefPubMed Hernandez N, Song Y, Noble VE, Eisner BH. Predicting ureteral stones in emergency department patients with flank pain: an external validation of the STONE score. World J Urol. 2016 Oct;34(10):1443–6.CrossRefPubMed
9.
go back to reference Daniels B, Gross CP, Molinaro A, Singh D, Luty S, Jessey R, Moore CL. STONE PLUS: Evaluation of emergency department patients with suspected renal colic, using a clinical prediction tool combined with point-of-care limited ultrasonography. Ann Emerg Med. 2016 Apr;67(4):439–48.CrossRefPubMed Daniels B, Gross CP, Molinaro A, Singh D, Luty S, Jessey R, Moore CL. STONE PLUS: Evaluation of emergency department patients with suspected renal colic, using a clinical prediction tool combined with point-of-care limited ultrasonography. Ann Emerg Med. 2016 Apr;67(4):439–48.CrossRefPubMed
10.
go back to reference Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, Moody B, Szolovits P, Celi LA, Mark RG. MIMIC-III, a freely accessible critical care database. Sci Data. 2016 May 24;3:160035.CrossRefPubMedPubMedCentral Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, Moody B, Szolovits P, Celi LA, Mark RG. MIMIC-III, a freely accessible critical care database. Sci Data. 2016 May 24;3:160035.CrossRefPubMedPubMedCentral
11.
go back to reference Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992 Jun;45(6):613–9.CrossRefPubMed Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992 Jun;45(6):613–9.CrossRefPubMed
12.
go back to reference Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF 3rd, Feldman HI, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med. 2009;150(9):604–12.CrossRefPubMedPubMedCentral Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF 3rd, Feldman HI, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med. 2009;150(9):604–12.CrossRefPubMedPubMedCentral
13.
go back to reference Benjamini Y, Heller R. False discovery rates for spatial signals. JASA. 2007 Dec;102(480):1272–81.CrossRef Benjamini Y, Heller R. False discovery rates for spatial signals. JASA. 2007 Dec;102(480):1272–81.CrossRef
14.
go back to reference Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: data mining, inference, and prediction. Second edition. New York: Springer; 2009. Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: data mining, inference, and prediction. Second edition. New York: Springer; 2009.
15.
go back to reference Nadeau C, Bengio Y. Inference for the generalization error. Mach Learn. 2003;52:239.CrossRef Nadeau C, Bengio Y. Inference for the generalization error. Mach Learn. 2003;52:239.CrossRef
16.
go back to reference Quinlan, J. R. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, 1993. Quinlan, J. R. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, 1993.
17.
go back to reference Friedman J, Hastie T, Tibshirani R. Additive logistic regression: a statistical view of boosting. Ann Stat. 2000;28(2):337–407.CrossRef Friedman J, Hastie T, Tibshirani R. Additive logistic regression: a statistical view of boosting. Ann Stat. 2000;28(2):337–407.CrossRef
18.
go back to reference Breiman, L. Random Forests Machine Learning 2001, 45: 5–32. Breiman, L. Random Forests Machine Learning 2001, 45: 5–32.
19.
go back to reference van der Laan MJ, Polley EC, Hubbard AE. Super learner. Stat Appl Genet Mol Biol. 2007;6: Article25. van der Laan MJ, Polley EC, Hubbard AE. Super learner. Stat Appl Genet Mol Biol. 2007;6: Article25.
20.
go back to reference Chawla NV, Bowyer KW, Hall LO, Kegelmeyer W. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.CrossRef Chawla NV, Bowyer KW, Hall LO, Kegelmeyer W. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.CrossRef
21.
go back to reference Fawcett T. An introduction to ROC analysis. Pattern Recogn Lett. 2006;27:861–74.CrossRef Fawcett T. An introduction to ROC analysis. Pattern Recogn Lett. 2006;27:861–74.CrossRef
22.
go back to reference Schisterman EF, Perkins NJ, Liu A, Bondell H. Optimal cut-point and its corresponding Youden index to discriminate individuals using pooled blood samples. Epidemiology. 2005 Jan;16(1):73–81.CrossRefPubMed Schisterman EF, Perkins NJ, Liu A, Bondell H. Optimal cut-point and its corresponding Youden index to discriminate individuals using pooled blood samples. Epidemiology. 2005 Jan;16(1):73–81.CrossRefPubMed
23.
go back to reference Frank E, Hall MA, Witten IH. The WEKA Workbench. Online Appendix for "Data Mining: Practical Machine Learning Tools and Techniques", Morgan Kaufmann, Fourth Edition, 2016. Frank E, Hall MA, Witten IH. The WEKA Workbench. Online Appendix for "Data Mining: Practical Machine Learning Tools and Techniques", Morgan Kaufmann, Fourth Edition, 2016.
24.
go back to reference Watnick S, Weiner DE, Shaffer R, Inrig J, Moe S, Mehrotra R. Dialysis advisory Group of the American Society of nephrology. Comparing mandated health care reforms: the affordable care act, accountable care organizations, and the Medicare ESRD program. Clin J Am Soc Nephrol. 2012 Sep;7(9):1535–43.CrossRefPubMed Watnick S, Weiner DE, Shaffer R, Inrig J, Moe S, Mehrotra R. Dialysis advisory Group of the American Society of nephrology. Comparing mandated health care reforms: the affordable care act, accountable care organizations, and the Medicare ESRD program. Clin J Am Soc Nephrol. 2012 Sep;7(9):1535–43.CrossRefPubMed
25.
go back to reference Scales CD Jr, Lin L, Saigal CS, Bennett CJ, Ponce NA, Mangione CM, Litwin MS. NIDDK urologic diseases in America project. Emergency department revisits for patients with kidney stones in California. Acad Emerg Med. 2015 Apr;22(4):468–74.CrossRefPubMedPubMedCentral Scales CD Jr, Lin L, Saigal CS, Bennett CJ, Ponce NA, Mangione CM, Litwin MS. NIDDK urologic diseases in America project. Emergency department revisits for patients with kidney stones in California. Acad Emerg Med. 2015 Apr;22(4):468–74.CrossRefPubMedPubMedCentral
27.
28.
go back to reference Xu C, Zhang C, Wang XL, Liu TZ, Zeng XT, Li S, Duan XW. Self-fluid Management in Prevention of kidney stones: a PRISMA-compliant systematic review and dose-response meta-analysis of observational studies. Medicine (Baltimore). 2015 Jul;94(27):e1042.CrossRef Xu C, Zhang C, Wang XL, Liu TZ, Zeng XT, Li S, Duan XW. Self-fluid Management in Prevention of kidney stones: a PRISMA-compliant systematic review and dose-response meta-analysis of observational studies. Medicine (Baltimore). 2015 Jul;94(27):e1042.CrossRef
29.
30.
go back to reference Junge W, Mályusz M, Ehrens HJ. The role of the kidney in the elimination of pancreatic lipase and amylase from blood. J Clin Chem Clin Biochem. 1985 Jul;23(7):387–92.PubMed Junge W, Mályusz M, Ehrens HJ. The role of the kidney in the elimination of pancreatic lipase and amylase from blood. J Clin Chem Clin Biochem. 1985 Jul;23(7):387–92.PubMed
31.
go back to reference Mead JR, Irvine SA, Ramji DP. Lipoprotein lipase: structure, function, regulation, and role in disease. J Mol Med (Berl). 2002 Dec;80(12):753–69.CrossRef Mead JR, Irvine SA, Ramji DP. Lipoprotein lipase: structure, function, regulation, and role in disease. J Mol Med (Berl). 2002 Dec;80(12):753–69.CrossRef
32.
go back to reference Jeremias A, Albirini A, Ziada KM, Chew DP, Brener SJ, Topol EJ, Ellis SG. Prognostic significance of creatine kinase-MB elevation after percutaneous coronary intervention in patients with chronic renal dysfunction. Am Heart J. 2002 Jun;143(6):1040–5.CrossRefPubMed Jeremias A, Albirini A, Ziada KM, Chew DP, Brener SJ, Topol EJ, Ellis SG. Prognostic significance of creatine kinase-MB elevation after percutaneous coronary intervention in patients with chronic renal dysfunction. Am Heart J. 2002 Jun;143(6):1040–5.CrossRefPubMed
33.
go back to reference Welch BJ, Graybeal D, Moe OW, Maalouf NM, Sakhaee K. Biochemical and stone-risk profiles with topiramate treatment. Am J Kidney Dis. 2006 Oct;48(4):555–63.CrossRefPubMed Welch BJ, Graybeal D, Moe OW, Maalouf NM, Sakhaee K. Biochemical and stone-risk profiles with topiramate treatment. Am J Kidney Dis. 2006 Oct;48(4):555–63.CrossRefPubMed
34.
go back to reference Lucchesi C, Baldacci F, Cafalli M, Dini E, Giampietri L, Siciliano G, Gori S. Fatigue, sleep-wake pattern, depressive and anxiety symptoms and body-mass index: analysis in a sample of episodic and chronic migraine patients. Neurol Sci. 2016 Jun;37(6):987–9.CrossRefPubMed Lucchesi C, Baldacci F, Cafalli M, Dini E, Giampietri L, Siciliano G, Gori S. Fatigue, sleep-wake pattern, depressive and anxiety symptoms and body-mass index: analysis in a sample of episodic and chronic migraine patients. Neurol Sci. 2016 Jun;37(6):987–9.CrossRefPubMed
35.
go back to reference Pakzad R, Safiri S. Poor sleep quality predicts Hypogonadal symptoms and sexual dysfunction in male non-standard shift workers: methodological issues to avoid prediction fallacy. Urology. 2017 Jan;23 Pakzad R, Safiri S. Poor sleep quality predicts Hypogonadal symptoms and sexual dysfunction in male non-standard shift workers: methodological issues to avoid prediction fallacy. Urology. 2017 Jan;23
36.
go back to reference Otunctemur A, Ozbek E, Cakir SS, Dursun M, Polat EC, Ozcan L, Besiroglu H. Urolithiasis is associated with low serum testosterone levels in men. Arch Ital Urol Androl. 2015 Mar 31;87(1):83–6.CrossRefPubMed Otunctemur A, Ozbek E, Cakir SS, Dursun M, Polat EC, Ozcan L, Besiroglu H. Urolithiasis is associated with low serum testosterone levels in men. Arch Ital Urol Androl. 2015 Mar 31;87(1):83–6.CrossRefPubMed
37.
go back to reference Reyner K, Heffner AC, Karvetski CH. Urinary obstruction is an important complicating factor in patients with septic shock due to urinary infection. Am J Emerg Med. 2016 Apr;34(4):694–6.CrossRefPubMed Reyner K, Heffner AC, Karvetski CH. Urinary obstruction is an important complicating factor in patients with septic shock due to urinary infection. Am J Emerg Med. 2016 Apr;34(4):694–6.CrossRefPubMed
38.
39.
go back to reference Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW, Vickers AJ, Ransohoff DF, Collins GS. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015 Jan 6;162(1):W1–73.CrossRefPubMed Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW, Vickers AJ, Ransohoff DF, Collins GS. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015 Jan 6;162(1):W1–73.CrossRefPubMed
Metadata
Title
Development of a personalized diagnostic model for kidney stone disease tailored to acute care by integrating large clinical, demographics and laboratory data: the diagnostic acute care algorithm - kidney stones (DACA-KS)
Authors
Zhaoyi Chen
Victoria Y. Bird
Rupam Ruchi
Mark S. Segal
Jiang Bian
Saeed R. Khan
Marie-Carmelle Elie
Mattia Prosperi
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2018
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-018-0652-4

Other articles of this Issue 1/2018

BMC Medical Informatics and Decision Making 1/2018 Go to the issue