Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Database

An open access medical knowledge base for community driven diagnostic decision support system development

Authors: Lars Müller, Rashmi Gangadharaiah, Simone C. Klein, James Perry, Greg Bernstein, David Nurkse, Dustin Wailes, Rishi Graham, Robert El-Kareh, Sanjay Mehta, Staal A. Vinterbo, Eliah Aronoff-Spencer

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Introduction

While early diagnostic decision support systems were built around knowledge bases, more recent systems employ machine learning to consume large amounts of health data. We argue curated knowledge bases will remain an important component of future diagnostic decision support systems by providing ground truth and facilitating explainable human-computer interaction, but that prototype development is hampered by the lack of freely available computable knowledge bases.

Methods

We constructed an open access knowledge base and evaluated its potential in the context of a prototype decision support system. We developed a modified set-covering algorithm to benchmark the performance of our knowledge base compared to existing platforms. Testing was based on case reports from selected literature and medical student preparatory material.

Results

The knowledge base contains over 2000 ICD-10 coded diseases and 450 RX-Norm coded medications, with over 8000 unique observations encoded as SNOMED or LOINC semantic terms. Using 117 medical cases, we found the accuracy of the knowledge base and test algorithm to be comparable to established diagnostic tools such as Isabel and DXplain. Our prototype, as well as DXplain, showed the correct answer as “best suggestion” in 33% of the cases. While we identified shortcomings during development and evaluation, we found the knowledge base to be a promising platform for decision support systems.

Conclusion

We built and successfully evaluated an open access knowledge base to facilitate the development of new medical diagnostic assistants. This knowledge base can be expanded and curated by users and serve as a starting point to facilitate new technology development and system improvement in many contexts.
Appendix
Available only for authorised users
Literature
1.
go back to reference Balogh EP, Miller BT, Ball JR. Improving diagnosis in health care. Washington, DC: National Academies Press; 2016. Balogh EP, Miller BT, Ball JR. Improving diagnosis in health care. Washington, DC: National Academies Press; 2016.
2.
go back to reference Shortliffe E. Computer-based medical consultations: Mycin. Washington, DC: Elsevier; 1976. Shortliffe E. Computer-based medical consultations: Mycin. Washington, DC: Elsevier; 1976.
3.
go back to reference Miller RA, Pople HEJ, Myers JD. Internist-I, an experimental computer-based diagnostic consultant for general internal medicine. New England J Med. 1982:307(8):468-76. Miller RA, Pople HEJ, Myers JD. Internist-I, an experimental computer-based diagnostic consultant for general internal medicine. New England J Med. 1982:307(8):468-76.
4.
go back to reference Hoffer EP, Feldman MJ, Kim RJ, Famiglietti K, Barnett GO. DXplain: patterns of use of a mature expert system. In: AMIA. 2005. p. 321–4. Hoffer EP, Feldman MJ, Kim RJ, Famiglietti K, Barnett GO. DXplain: patterns of use of a mature expert system. In: AMIA. 2005. p. 321–4.
5.
go back to reference Greenes RA, Shortliffe EH. Commentary: Informatics in biomedicine and health care. Acad Med. 2009;84(7):818–20. Greenes RA, Shortliffe EH. Commentary: Informatics in biomedicine and health care. Acad Med. 2009;84(7):818–20.
6.
go back to reference El-Kareh R, Hasan O, Schiff GD. Use of health information technology to reduce diagnostic errors. BMJ Qual Safety. 2013;22(Suppl 2):ii40–51. El-Kareh R, Hasan O, Schiff GD. Use of health information technology to reduce diagnostic errors. BMJ Qual Safety. 2013;22(Suppl 2):ii40–51.
7.
go back to reference Lobach DF. The road to effective clinical decision support: are we there yet?. BMJ. 2013:f1616. Lobach DF. The road to effective clinical decision support: are we there yet?. BMJ. 2013:f1616.
8.
go back to reference Miotto R, Li L, Kidd BA, Dudley JT. Deep patient: an unsupervised representation to predict the future of patients from the electronic health records. Scient Rep Nat Publish Group. 2016;6(1):26094. Miotto R, Li L, Kidd BA, Dudley JT. Deep patient: an unsupervised representation to predict the future of patients from the electronic health records. Scient Rep Nat Publish Group. 2016;6(1):26094.
9.
go back to reference Zauderer MG, Gucalp A, Epstein AS, Seidman AD, Caroline A, Granovsky S, et al. Piloting IBM Watson oncology within memorial Sloan Kettering’s regional network. J Clin Oncol. 2014;32(15_suppl):e17653.CrossRef Zauderer MG, Gucalp A, Epstein AS, Seidman AD, Caroline A, Granovsky S, et al. Piloting IBM Watson oncology within memorial Sloan Kettering’s regional network. J Clin Oncol. 2014;32(15_suppl):e17653.CrossRef
10.
go back to reference Ramnarayan P, Tomlinson A, Rao A, Coren M, Winrow A, Britto J. ISABEL: a web-based differential diagnostic aid for paediatrics: results from an initial performance evaluation. Arch Dis Child Springer. 2003;88(5):408–13.CrossRef Ramnarayan P, Tomlinson A, Rao A, Coren M, Winrow A, Britto J. ISABEL: a web-based differential diagnostic aid for paediatrics: results from an initial performance evaluation. Arch Dis Child Springer. 2003;88(5):408–13.CrossRef
11.
go back to reference Dragusin R, Petcu P, Lioma C, Larsen B, Jørgensen HL, Cox IJ, et al. FindZebra: a search engine for rare diseases. Int J Med Inform. 2013;82(6):528–38.CrossRef Dragusin R, Petcu P, Lioma C, Larsen B, Jørgensen HL, Cox IJ, et al. FindZebra: a search engine for rare diseases. Int J Med Inform. 2013;82(6):528–38.CrossRef
12.
go back to reference Kahneman D. Thinking, fast and slow. New York: Farrar, Straus & Giroux; 2012. Kahneman D. Thinking, fast and slow. New York: Farrar, Straus & Giroux; 2012.
13.
go back to reference Stone P, Brook R, Brynjolfsson E, Calo R, Etzioni O, Hager G, et al. Artificial Intelligence and Life in 2030." One hundred year study on artificial intelligence. Stanford CA; 2016. Stone P, Brook R, Brynjolfsson E, Calo R, Etzioni O, Hager G, et al. Artificial Intelligence and Life in 2030." One hundred year study on artificial intelligence. Stanford CA; 2016.
14.
go back to reference Miller RA. The demise of the “Greek Oracle” model for medical diagnostic systems. Methods Inf Med. 1990;29(1):1–2.CrossRef Miller RA. The demise of the “Greek Oracle” model for medical diagnostic systems. Methods Inf Med. 1990;29(1):1–2.CrossRef
15.
go back to reference Vardell E, Bou-Crick C. VisualDx: a visual diagnostic decision support tool. Med ref Serv Q. Taylor & Francis Group. 2012;31(4):414–24.CrossRef Vardell E, Bou-Crick C. VisualDx: a visual diagnostic decision support tool. Med ref Serv Q. Taylor & Francis Group. 2012;31(4):414–24.CrossRef
16.
go back to reference Ribeiro MT, Singh S, Guestrin C. “Why Should I Trust You?” Explaining the Predictions of Any Classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD ‘16 . New York: ACM Press; 2016. p. 1135–44. Ribeiro MT, Singh S, Guestrin C. “Why Should I Trust You?” Explaining the Predictions of Any Classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD ‘16 . New York: ACM Press; 2016. p. 1135–44.
17.
go back to reference McCray AT, Nelson SJ. The representation of meaning in the UMLS. Methods Inf Med. Schattauer GmbH. 1995;34(01/02):193–201.CrossRef McCray AT, Nelson SJ. The representation of meaning in the UMLS. Methods Inf Med. Schattauer GmbH. 1995;34(01/02):193–201.CrossRef
18.
go back to reference Denekamp Y, Peleg, M. TiMeDDx—A multi-phase anchor-based diagnostic decision-support model. J Biomed Inform. 2010;43(1):111-24. Denekamp Y, Peleg, M. TiMeDDx—A multi-phase anchor-based diagnostic decision-support model. J Biomed Inform. 2010;43(1):111-24.
19.
go back to reference Kawamoto K, Houlihan C, Balas A, Lobach D. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Bmj. 2005;330(7494):765.CrossRef Kawamoto K, Houlihan C, Balas A, Lobach D. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Bmj. 2005;330(7494):765.CrossRef
20.
go back to reference Segundo U, López-Cuadrado J, Aldamiz-Echevarria L, Pérez TA, Buenestado D, Iruetaguena A, et al. Automatic construction of fuzzy inference systems for computerized clinical guidelines and protocols. Appl Soft Comput. 2015;26:257–69.CrossRef Segundo U, López-Cuadrado J, Aldamiz-Echevarria L, Pérez TA, Buenestado D, Iruetaguena A, et al. Automatic construction of fuzzy inference systems for computerized clinical guidelines and protocols. Appl Soft Comput. 2015;26:257–69.CrossRef
21.
go back to reference Fox G, Moawad N. UpToDate: A comprehensive clinical database. J Fam Pract. 2003;52(9):706–10.PubMed Fox G, Moawad N. UpToDate: A comprehensive clinical database. J Fam Pract. 2003;52(9):706–10.PubMed
22.
go back to reference Gilbert DN, Moellering RC, Sande MA. The Sanford guide to antimicrobial therapy, vol. 48. Washington, DC: Antimicrobial Therapy Incorporated; 2003. Gilbert DN, Moellering RC, Sande MA. The Sanford guide to antimicrobial therapy, vol. 48. Washington, DC: Antimicrobial Therapy Incorporated; 2003.
23.
go back to reference Yu VL, Edberg SC. Global infectious diseases and epidemiology network (GIDEON): a world wide web-based program for diagnosis and informatics in infectious diseases. Clin Infect Dis. Oxford University Press. 2005;40(1):123–6.CrossRef Yu VL, Edberg SC. Global infectious diseases and epidemiology network (GIDEON): a world wide web-based program for diagnosis and informatics in infectious diseases. Clin Infect Dis. Oxford University Press. 2005;40(1):123–6.CrossRef
24.
go back to reference Carter JH. Design and Implementation Issues. In: Clinical decision support systems. New York, NY: Springer New York; 2007. p. 64–98.CrossRef Carter JH. Design and Implementation Issues. In: Clinical decision support systems. New York, NY: Springer New York; 2007. p. 64–98.CrossRef
25.
go back to reference Bennett JE, Dolin R, Blaser MJ. Mandell, Douglas and Bennett’s infectious disease essentials. Philadelphia: Elsevier Health Sciences; 2016 Bennett JE, Dolin R, Blaser MJ. Mandell, Douglas and Bennett’s infectious disease essentials. Philadelphia: Elsevier Health Sciences; 2016
26.
go back to reference Papadakis MA, McPhee SJ, Tierney LM. Current medical diagnosis & treatment 2014 (LANGE CURRENT series). McGraw-Hill Medical New York; 2014. Papadakis MA, McPhee SJ, Tierney LM. Current medical diagnosis & treatment 2014 (LANGE CURRENT series). McGraw-Hill Medical New York; 2014.
27.
go back to reference Fauci AS, et al. Harrison’s principles of internal Medicine. New York: McGraw-Hill, Medical Publishing Division; 2008. Fauci AS, et al. Harrison’s principles of internal Medicine. New York: McGraw-Hill, Medical Publishing Division; 2008.
28.
go back to reference Brent A, Davidson R, Seale A. Oxford handbook of tropical medicine. Washington, DC: Oxford University Press; 2014. Brent A, Davidson R, Seale A. Oxford handbook of tropical medicine. Washington, DC: Oxford University Press; 2014.
29.
go back to reference Longmore M, Wilkinson I, Baldwin A, Wallin E. Oxford handbook of clinical medicine. Washington, DC: Oxford University Press; 2014. Longmore M, Wilkinson I, Baldwin A, Wallin E. Oxford handbook of clinical medicine. Washington, DC: Oxford University Press; 2014.
30.
go back to reference Hilal-Dandan R, Brunton L. Goodman and Gilman’s manual of pharmacology and therapeutics. Washington, DC: McGraw Hill Professional; 2013. Hilal-Dandan R, Brunton L. Goodman and Gilman’s manual of pharmacology and therapeutics. Washington, DC: McGraw Hill Professional; 2013.
32.
go back to reference Schuyler PL, Hole WT, Tuttle MS, Sherertz DD. The UMLS Metathesaurus: representing different views of biomedical concepts. Bull Med Libr Assoc. 1993:81(2);217–22. Schuyler PL, Hole WT, Tuttle MS, Sherertz DD. The UMLS Metathesaurus: representing different views of biomedical concepts. Bull Med Libr Assoc. 1993:81(2);217–22.
33.
go back to reference Bond WF, Schwartz LM, Weaver KR, Levick D, Giuliano M, Graber ML. Differential diagnosis generators: an evaluation of currently available computer programs. J Gen Intern Med. 2012;27(2):213–9.CrossRef Bond WF, Schwartz LM, Weaver KR, Levick D, Giuliano M, Graber ML. Differential diagnosis generators: an evaluation of currently available computer programs. J Gen Intern Med. 2012;27(2):213–9.CrossRef
34.
go back to reference Reggia JA, Nau DS, Wang PY. Diagnostic expert systems based on a set covering model. Intl J Man-Machine Stud. 1983;19:437–60.CrossRef Reggia JA, Nau DS, Wang PY. Diagnostic expert systems based on a set covering model. Intl J Man-Machine Stud. 1983;19:437–60.CrossRef
Metadata
Title
An open access medical knowledge base for community driven diagnostic decision support system development
Authors
Lars Müller
Rashmi Gangadharaiah
Simone C. Klein
James Perry
Greg Bernstein
David Nurkse
Dustin Wailes
Rishi Graham
Robert El-Kareh
Sanjay Mehta
Staal A. Vinterbo
Eliah Aronoff-Spencer
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-0804-1

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue