Skip to main content
Top
Published in: Orphanet Journal of Rare Diseases 1/2019

Open Access 01-12-2019 | Research

Can a decision support system accelerate rare disease diagnosis? Evaluating the potential impact of Ada DX in a retrospective study

Authors: Simon Ronicke, Martin C. Hirsch, Ewelina Türk, Katharina Larionov, Daphne Tientcheu, Annette D. Wagner

Published in: Orphanet Journal of Rare Diseases | Issue 1/2019

Login to get access

Abstract

Background

Rare disease diagnosis is often delayed by years. A primary factor for this delay is a lack of knowledge and awareness regarding rare diseases. Probabilistic diagnostic decision support systems (DDSSs) have the potential to accelerate rare disease diagnosis by suggesting differential diagnoses for physicians based on case input and incorporated medical knowledge. We examine the DDSS prototype Ada DX and assess its potential to provide accurate rare disease suggestions early in the course of rare disease cases.

Results

Ada DX suggested the correct disease earlier than the time of clinical diagnosis among the top five fit disease suggestions in 53.8% of cases (50 of 93), and as the top fit disease suggestion in 37.6% of cases (35 of 93). The median advantage of correct disease suggestions compared to the time of clinical diagnosis was 3 months or 50% for top five fit and 1 month or 21% for top fit. The correct diagnosis was suggested at the first documented patient visit in 33.3% (top 5 fit), and 16.1% of cases (top fit), respectively. Wilcoxon signed-rank test shows a significant difference between the time to clinical diagnosis and the time to correct disease suggestion for both top five fit and top fit (z-score -6.68, respective -5.71, α=0.05, p-value <0.001).

Conclusion

Ada DX provided accurate rare disease suggestions in most rare disease cases. In many cases, Ada DX provided correct rare disease suggestions early in the course of the disease, sometimes at the very beginning of a patient journey. The interpretation of these results indicates that Ada DX has the potential to suggest rare diseases to physicians early in the course of a case. Limitations of this study derive from its retrospective and unblinded design, data input by a single user, and the optimization of the knowledge base during the course of the study. Results pertaining to the system’s accuracy should be interpreted cautiously. Whether the use of Ada DX reduces the time to diagnosis in rare diseases in a clinical setting should be validated in prospective studies.
Appendix
Available only for authorised users
Literature
18.
go back to reference Kostopoulou O, Rosen A, Round T, Wright E, Douiri A, Delaney B. Early diagnostic suggestions improve accuracy of GPs: a randomised controlled trial using computer-simulated patients. Br J Gen Pract. 2015; 65(630):e49–54. Available from: https://doi.org/10.3399/bjgp15X683161. Kostopoulou O, Rosen A, Round T, Wright E, Douiri A, Delaney B. Early diagnostic suggestions improve accuracy of GPs: a randomised controlled trial using computer-simulated patients. Br J Gen Pract. 2015; 65(630):e49–54. Available from: https://​doi.​org/​10.​3399/​bjgp15X683161.
19.
go back to reference Kostopoulou O, Lionis C, Angelaki A, Ayis S, Durbaba S, Delaney BC. Early diagnostic suggestions improve accuracy of family physicians: a randomized controlled trial in Greece. Fam Pract. 2015; 32(3):323–328. Available from: https://doi.org/10.1093/fampra/cmv012. Kostopoulou O, Lionis C, Angelaki A, Ayis S, Durbaba S, Delaney BC. Early diagnostic suggestions improve accuracy of family physicians: a randomized controlled trial in Greece. Fam Pract. 2015; 32(3):323–328. Available from: https://​doi.​org/​10.​1093/​fampra/​cmv012.
23.
go back to reference Online Mendelian Inheritance in Man, OMIM®. Johns Hopkins University (Baltimore, MD): McKusick-Nathans Institute of Genetic Medicine. Available from: https://omim.org/. Online Mendelian Inheritance in Man, OMIM®. Johns Hopkins University (Baltimore, MD): McKusick-Nathans Institute of Genetic Medicine. Available from: https://​omim.​org/​.
33.
go back to reference Ramnarayan P, Roberts GC, Coren M, Nanduri V, Tomlinson A, Taylor PM, et al.Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Making. 2006; 6(1):22. Available from: https://doi.org/10.1186/1472-6947-6-22. Ramnarayan P, Roberts GC, Coren M, Nanduri V, Tomlinson A, Taylor PM, et al.Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Making. 2006; 6(1):22. Available from: https://​doi.​org/​10.​1186/​1472-6947-6-22.
34.
go back to reference Elkin PL, Liebow M, Bauer BA, Chaliki S, Wahner-Roedler D, Bundrick J, et al.The introduction of a diagnostic decision support system (DXplain™) into the workflow of a teaching hospital service can decrease the cost of service for diagnostically challenging Diagnostic Related Groups (DRGs). Int J Med Inform. 2010; 11;79(11):772–7. Available from: https://doi.org/10.1016/j.ijmedinf.2010.09.004. Elkin PL, Liebow M, Bauer BA, Chaliki S, Wahner-Roedler D, Bundrick J, et al.The introduction of a diagnostic decision support system (DXplain™) into the workflow of a teaching hospital service can decrease the cost of service for diagnostically challenging Diagnostic Related Groups (DRGs). Int J Med Inform. 2010; 11;79(11):772–7. Available from: https://​doi.​org/​10.​1016/​j.​ijmedinf.​2010.​09.​004.
Metadata
Title
Can a decision support system accelerate rare disease diagnosis? Evaluating the potential impact of Ada DX in a retrospective study
Authors
Simon Ronicke
Martin C. Hirsch
Ewelina Türk
Katharina Larionov
Daphne Tientcheu
Annette D. Wagner
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Orphanet Journal of Rare Diseases / Issue 1/2019
Electronic ISSN: 1750-1172
DOI
https://doi.org/10.1186/s13023-019-1040-6

Other articles of this Issue 1/2019

Orphanet Journal of Rare Diseases 1/2019 Go to the issue