Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2018

Open Access 01-12-2018 | Research article

A decision support system to follow up and diagnose primary headache patients using semantically enriched data

Authors: Gilles Vandewiele, Femke De Backere, Kiani Lannoye, Maarten Vanden Berghe, Olivier Janssens, Sofie Van Hoecke, Vincent Keereman, Koen Paemeleire, Femke Ongenae, Filip De Turck

Published in: BMC Medical Informatics and Decision Making | Issue 1/2018

Login to get access

Abstract

Background

Headache disorders are an important health burden, having a large health-economic impact worldwide. Current treatment & follow-up processes are often archaic, creating opportunities for computer-aided and decision support systems to increase their efficiency. Existing systems are mostly completely data-driven, and the underlying models are a black-box, deteriorating interpretability and transparency, which are key factors in order to be deployed in a clinical setting.

Methods

In this paper, a decision support system is proposed, composed of three components: (i) a cross-platform mobile application to capture the required data from patients to formulate a diagnosis, (ii) an automated diagnosis support module that generates an interpretable decision tree, based on data semantically annotated with expert knowledge, in order to support physicians in formulating the correct diagnosis and (iii) a web application such that the physician can efficiently interpret captured data and learned insights by means of visualizations.

Results

We show that decision tree induction techniques achieve competitive accuracy rates, compared to other black- and white-box techniques, on a publicly available dataset, referred to as migbase. Migbase contains aggregated information of headache attacks from 849 patients. Each sample is labeled with one of three possible primary headache disorders. We demonstrate that we are able to reduce the classification error, statistically significant (ρ≤0.05), with more than 10% by balancing the dataset using prior expert knowledge. Furthermore, we achieve high accuracy rates by using features extracted using the Weisfeiler-Lehman kernel, which is completely unsupervised. This makes it an ideal approach to solve a potential cold start problem.

Conclusion

Decision trees are the perfect candidate for the automated diagnosis support module. They achieve predictive performances competitive to other techniques on the migbase dataset and are, foremost, completely interpretable. Moreover, the incorporation of prior knowledge increases both predictive performance as well as transparency of the resulting predictive model on the studied dataset.
Literature
1.
go back to reference Abu Bakar N, Tanprawate S, Lambru G, Torkamani M, Jahanshahi M, Matharu M. Quality of life in primary headache disorders: a review. Cephalalgia. 2016; 36(1):67–91.CrossRef Abu Bakar N, Tanprawate S, Lambru G, Torkamani M, Jahanshahi M, Matharu M. Quality of life in primary headache disorders: a review. Cephalalgia. 2016; 36(1):67–91.CrossRef
2.
go back to reference Steiner TJ, Stovner LJ, Katsarava P-DDZ, Jensen R, Birbeck GL, Martelletti P. Lifting the burden: The global campaign against headache. 2011:737–744.CrossRef Steiner TJ, Stovner LJ, Katsarava P-DDZ, Jensen R, Birbeck GL, Martelletti P. Lifting the burden: The global campaign against headache. 2011:737–744.CrossRef
4.
go back to reference Stovner LJ, Zwart Ja, Hagen K, Terwindt GM, Pascual J. Epidemiology of headache in Europe. Eur J Neurol. 2006; 13(4):333–45.CrossRef Stovner LJ, Zwart Ja, Hagen K, Terwindt GM, Pascual J. Epidemiology of headache in Europe. Eur J Neurol. 2006; 13(4):333–45.CrossRef
5.
go back to reference Gustavsson A, Svensson M, Jacobi F, Allgulander C, Alonso J, Beghi E, Dodel R, Ekman M, Faravelli C, Fratiglioni L, et al. Cost of disorders of the brain in europe 2010. Eur Neuropsychopharmacol. 2011; 21(10):718–79.CrossRef Gustavsson A, Svensson M, Jacobi F, Allgulander C, Alonso J, Beghi E, Dodel R, Ekman M, Faravelli C, Fratiglioni L, et al. Cost of disorders of the brain in europe 2010. Eur Neuropsychopharmacol. 2011; 21(10):718–79.CrossRef
6.
go back to reference Pareja JA, Álvarez M. The usual treatment of trigeminal autonomic cephalalgias. Headache J Head Face Pain. 2013; 53(9):1401–14.CrossRef Pareja JA, Álvarez M. The usual treatment of trigeminal autonomic cephalalgias. Headache J Head Face Pain. 2013; 53(9):1401–14.CrossRef
7.
go back to reference Felício AC, Bichuetti DB, Santos WACd, Junior G, de Oliveira C, Marin LF, Carvalho DdS. Epidemiology of primary and secondary headaches in a brazilian tertiary-care center. Arq Neuropsiquiatr. 2006; 64(1):41–44.CrossRef Felício AC, Bichuetti DB, Santos WACd, Junior G, de Oliveira C, Marin LF, Carvalho DdS. Epidemiology of primary and secondary headaches in a brazilian tertiary-care center. Arq Neuropsiquiatr. 2006; 64(1):41–44.CrossRef
8.
go back to reference Vos T, Allen C, Arora M, Barber RM, Bhutta ZA, Brown A, Carter A, Casey DC, Charlson FJ, Chen AZ, et al.Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. The Lancet. 2016; 388(10053):1545–1602.CrossRef Vos T, Allen C, Arora M, Barber RM, Bhutta ZA, Brown A, Carter A, Casey DC, Charlson FJ, Chen AZ, et al.Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. The Lancet. 2016; 388(10053):1545–1602.CrossRef
9.
go back to reference Abajobir AA, Abate KH, Abbafati C, Abbas KM, Abd-Allah F, Abdulkader RS, Abdulle AM, Abebo TA, Abera SF, Aboyans V, et al. Global, regional, and national disability-adjusted life-years (dalys) for 333 diseases and injuries and healthy life expectancy (hale) for 195 countries and territories, 1990–2016: a systematic analysis for the global burden of disease study 2016. Lancet. 2017; 390(10100):1260–344.CrossRef Abajobir AA, Abate KH, Abbafati C, Abbas KM, Abd-Allah F, Abdulkader RS, Abdulle AM, Abebo TA, Abera SF, Aboyans V, et al. Global, regional, and national disability-adjusted life-years (dalys) for 333 diseases and injuries and healthy life expectancy (hale) for 195 countries and territories, 1990–2016: a systematic analysis for the global burden of disease study 2016. Lancet. 2017; 390(10100):1260–344.CrossRef
10.
go back to reference International Headache Society: The International Classification of Headache Disorders, 3rd edition (beta version). Cephalalgia. 2013; 33(9):629–808. International Headache Society: The International Classification of Headache Disorders, 3rd edition (beta version). Cephalalgia. 2013; 33(9):629–808.
11.
go back to reference Al-Hashel JY, Ahmed SF, Alroughani R, Goadsby PJ. Migraine misdiagnosis as a sinusitis, a delay that can last for many years. J Headache Pain. 2013; 14(1):97.CrossRef Al-Hashel JY, Ahmed SF, Alroughani R, Goadsby PJ. Migraine misdiagnosis as a sinusitis, a delay that can last for many years. J Headache Pain. 2013; 14(1):97.CrossRef
12.
go back to reference Cevoli S, D’amico D, Martelletti P, Valguarnera F, Del Bene E, De Simone R, Sarchielli P, Narbone M, Testa L, Genco S, et al. Underdiagnosis and undertreatment of migraine in italy: a survey of patients attending for the first time 10 headache centres. Cephalalgia. 2009; 29(12):1285–93.CrossRef Cevoli S, D’amico D, Martelletti P, Valguarnera F, Del Bene E, De Simone R, Sarchielli P, Narbone M, Testa L, Genco S, et al. Underdiagnosis and undertreatment of migraine in italy: a survey of patients attending for the first time 10 headache centres. Cephalalgia. 2009; 29(12):1285–93.CrossRef
13.
go back to reference Mehuys E, Paemeleire K, Van Hees T, Christiaens T, Van Bortel LM, Van Tongelen I, De Bolle L, Remon J-P, Boussery K. Self-medication of regular headache: a community pharmacy-based survey. Eur J Neurol. 2012; 19(8):1093–9.CrossRef Mehuys E, Paemeleire K, Van Hees T, Christiaens T, Van Bortel LM, Van Tongelen I, De Bolle L, Remon J-P, Boussery K. Self-medication of regular headache: a community pharmacy-based survey. Eur J Neurol. 2012; 19(8):1093–9.CrossRef
14.
go back to reference Van Alboom E, Louis P, Van Zandijcke M, Crevits L, Vakaet A, Paemeleire K. Diagnostic and therapeutic trajectory of cluster headache patients in flanders. Acta Neurologica Belgica. 2009; 109(1):10.PubMed Van Alboom E, Louis P, Van Zandijcke M, Crevits L, Vakaet A, Paemeleire K. Diagnostic and therapeutic trajectory of cluster headache patients in flanders. Acta Neurologica Belgica. 2009; 109(1):10.PubMed
15.
go back to reference Van Vliet J, Eekers P, Haan J, Ferrari M. Features involved in the diagnostic delay of cluster headache. J Neurol Neurosurg Psychiatry. 2003; 74(8):1123–5.CrossRef Van Vliet J, Eekers P, Haan J, Ferrari M. Features involved in the diagnostic delay of cluster headache. J Neurol Neurosurg Psychiatry. 2003; 74(8):1123–5.CrossRef
16.
go back to reference Voiticovschi-Iosob C, Allena M, De Cillis I, Nappi G, Sjaastad O, Antonaci F. Diagnostic and therapeutic errors in cluster headache: a hospital-based study. J Headache Pain. 2014; 15(1):56.CrossRef Voiticovschi-Iosob C, Allena M, De Cillis I, Nappi G, Sjaastad O, Antonaci F. Diagnostic and therapeutic errors in cluster headache: a hospital-based study. J Headache Pain. 2014; 15(1):56.CrossRef
17.
go back to reference Steiner TJ, Paemeleire K, Jensen R, Valade D, Savi L, Lainez MJ, Diener HC, Martelletti P, Couturier EG. European principles of management of common headache disorders in primary care. J Headache Pain. 2007; 8 Suppl 1:3–47. Steiner TJ, Paemeleire K, Jensen R, Valade D, Savi L, Lainez MJ, Diener HC, Martelletti P, Couturier EG. European principles of management of common headache disorders in primary care. J Headache Pain. 2007; 8 Suppl 1:3–47.
18.
go back to reference Lane SJ, Heddle NM, Arnold E, Walker I. A review of randomized controlled trials comparing the effectiveness of hand held computers with paper methods for data collection. BMC Med Inf Decis Making. 2006; 6(1):23.CrossRef Lane SJ, Heddle NM, Arnold E, Walker I. A review of randomized controlled trials comparing the effectiveness of hand held computers with paper methods for data collection. BMC Med Inf Decis Making. 2006; 6(1):23.CrossRef
19.
go back to reference Smitherman TA. Diagnosis and clinical evaluation. In: Clinician’s Manual on Migraine. Springer: 2016. p. 13–32. Smitherman TA. Diagnosis and clinical evaluation. In: Clinician’s Manual on Migraine. Springer: 2016. p. 13–32.
20.
go back to reference Giffin N, Ruggiero L, Lipton R, Silberstein S, Tvedskov J, Olesen J, Altman J, Goadsby PJ, Macrae A. Premonitory symptoms in migraine an electronic diary study. Neurology. 2003; 60(6):935–40.CrossRef Giffin N, Ruggiero L, Lipton R, Silberstein S, Tvedskov J, Olesen J, Altman J, Goadsby PJ, Macrae A. Premonitory symptoms in migraine an electronic diary study. Neurology. 2003; 60(6):935–40.CrossRef
21.
go back to reference Nappi G, Jensen R, Nappi R, Sances G, Torelli P, Olesen J. Diaries and calendars for migraine. a review. Cephalalgia. 2006; 26(8):905–16.CrossRef Nappi G, Jensen R, Nappi R, Sances G, Torelli P, Olesen J. Diaries and calendars for migraine. a review. Cephalalgia. 2006; 26(8):905–16.CrossRef
22.
go back to reference Allena M, Cuzzoni MG, Tassorelli C, Nappi G, Antonaci F. An electronic diary on a palm device for headache monitoring: a preliminary experience. J Headache Pain. 2012; 13(7):537–41.CrossRef Allena M, Cuzzoni MG, Tassorelli C, Nappi G, Antonaci F. An electronic diary on a palm device for headache monitoring: a preliminary experience. J Headache Pain. 2012; 13(7):537–41.CrossRef
23.
go back to reference Hundert AS, Huguet A, McGrath PJ, Stinson JN, Wheaton M. Commercially available mobile phone headache diary apps: a systematic review. JMIR mHealth uHealth. 2014; 2(3):1–13.CrossRef Hundert AS, Huguet A, McGrath PJ, Stinson JN, Wheaton M. Commercially available mobile phone headache diary apps: a systematic review. JMIR mHealth uHealth. 2014; 2(3):1–13.CrossRef
26.
go back to reference Caban JJ, Gotz D. Visual analytics in healthcare–opportunities and research challenges. Oxford: Oxford University Press; 2015. Caban JJ, Gotz D. Visual analytics in healthcare–opportunities and research challenges. Oxford: Oxford University Press; 2015.
27.
go back to reference Castaneda C, Nalley K, Mannion C, Bhattacharyya P, Blake P, Pecora A, Goy A, Suh KS. Clinical decision support systems for improving diagnostic accuracy and achieving precision medicine. J Clin Bioinforma. 2015; 5(1):4.CrossRef Castaneda C, Nalley K, Mannion C, Bhattacharyya P, Blake P, Pecora A, Goy A, Suh KS. Clinical decision support systems for improving diagnostic accuracy and achieving precision medicine. J Clin Bioinforma. 2015; 5(1):4.CrossRef
28.
go back to reference Keight R, Aljaaf AJ, Al-Jumeily D, Hussain AJ, Özge A, Mallucci C. An intelligent systems approach to primary headache diagnosis. In: International Conference on Intelligent Computing. Dordrecht: Springer: 2017. p. 61–72. Keight R, Aljaaf AJ, Al-Jumeily D, Hussain AJ, Özge A, Mallucci C. An intelligent systems approach to primary headache diagnosis. In: International Conference on Intelligent Computing. Dordrecht: Springer: 2017. p. 61–72.
29.
go back to reference Jackowski K, Jankowski D, Simić D, Simić S. In: Bogdanova AM, Gjorgjevikj D, (eds).Migraine Diagnosis Support System Based on Classifier Ensemble. Cham: Springer; 2015, pp. 329–39. Jackowski K, Jankowski D, Simić D, Simić S. In: Bogdanova AM, Gjorgjevikj D, (eds).Migraine Diagnosis Support System Based on Classifier Ensemble. Cham: Springer; 2015, pp. 329–39.
30.
go back to reference Krawczyk B, Simić D, Simić S, Woźniak M. Automatic diagnosis of primary headaches by machine learning methods. Open Med. 2013; 8(2):157–65.CrossRef Krawczyk B, Simić D, Simić S, Woźniak M. Automatic diagnosis of primary headaches by machine learning methods. Open Med. 2013; 8(2):157–65.CrossRef
31.
go back to reference Celik U, Yurtay N, Koc ER, Tepe N, Gulluoglu H, Ertas M. Migraine, tension-type and cluster-type of headaches classification by using immunos algorithms. J Med Imaging Health Informat. 2016; 6(5):1173–7.CrossRef Celik U, Yurtay N, Koc ER, Tepe N, Gulluoglu H, Ertas M. Migraine, tension-type and cluster-type of headaches classification by using immunos algorithms. J Med Imaging Health Informat. 2016; 6(5):1173–7.CrossRef
32.
go back to reference Celik U, YURTAY N. An ant colony optimization algorithm-based classification for the diagnosis of primary headaches using a website questionnaire expert system. Turk J Electr Eng Comput Sci. 2017; 25(5):4200–10.CrossRef Celik U, YURTAY N. An ant colony optimization algorithm-based classification for the diagnosis of primary headaches using a website questionnaire expert system. Turk J Electr Eng Comput Sci. 2017; 25(5):4200–10.CrossRef
33.
go back to reference Yin Z, Min L, Lu X, Duan H. A clinical decision support system for primary headache disorder based on hybrid intelligent reasoning. In: Biomedical Engineering and Informatics (BMEI), 2014 7th International Conference on. New Jersey: IEEE: 2014. p. 683–7. Yin Z, Min L, Lu X, Duan H. A clinical decision support system for primary headache disorder based on hybrid intelligent reasoning. In: Biomedical Engineering and Informatics (BMEI), 2014 7th International Conference on. New Jersey: IEEE: 2014. p. 683–7.
34.
go back to reference Yin Z, Dong Z, Yu S, Lu X, Feng G, Duan H. A guideline-based decision support system for headache diagnosis. Stud Health Technol Informat. 2013; 192:1022. Yin Z, Dong Z, Yu S, Lu X, Feng G, Duan H. A guideline-based decision support system for headache diagnosis. Stud Health Technol Informat. 2013; 192:1022.
35.
go back to reference Garcia-Chimeno Y, Garcia-Zapirain B, Gomez-Beldarrain M, Fernandez-Ruanova B, Garcia-Monco JC. Automatic migraine classification via feature selection committee and machine learning techniques over imaging and questionnaire data. BMC Med Inform Decis Making. 2017; 17(1):38.CrossRef Garcia-Chimeno Y, Garcia-Zapirain B, Gomez-Beldarrain M, Fernandez-Ruanova B, Garcia-Monco JC. Automatic migraine classification via feature selection committee and machine learning techniques over imaging and questionnaire data. BMC Med Inform Decis Making. 2017; 17(1):38.CrossRef
36.
go back to reference Vandewiele G. Enhancing white-box machine learning processes by incorporating semantic background knowledge. In: European Semantic Web Conference. Dordrecht: Springer: 2017. p. 267–78. Vandewiele G. Enhancing white-box machine learning processes by incorporating semantic background knowledge. In: European Semantic Web Conference. Dordrecht: Springer: 2017. p. 267–78.
37.
go back to reference Dou D, Wang H, Liu H. Semantic data mining: A survey of ontology-based approaches. In: Semantic Computing (ICSC), 2015 IEEE International Conference On. New Jersey: IEEE: 2015. p. 244–51. Dou D, Wang H, Liu H. Semantic data mining: A survey of ontology-based approaches. In: Semantic Computing (ICSC), 2015 IEEE International Conference On. New Jersey: IEEE: 2015. p. 244–51.
38.
go back to reference Ristoski P, Paulheim H. Semantic web in data mining and knowledge discovery: A comprehensive survey. Web Semant Sci Serv Agents World Wide Web. 2016; 36:1–22.CrossRef Ristoski P, Paulheim H. Semantic web in data mining and knowledge discovery: A comprehensive survey. Web Semant Sci Serv Agents World Wide Web. 2016; 36:1–22.CrossRef
40.
go back to reference Kromp F, Ambros I, Weiss T, Bogen D, Dodig H, Berneder M, Gerber T, Taschner-Mandl S, Ambros P, Hanbury A. Machine learning framework incorporating expert knowledge in tissue image annotation. In: Pattern Recognition (ICPR), 2016 23rd International Conference on. IEEE: 2016. p. 343–8. Kromp F, Ambros I, Weiss T, Bogen D, Dodig H, Berneder M, Gerber T, Taschner-Mandl S, Ambros P, Hanbury A. Machine learning framework incorporating expert knowledge in tissue image annotation. In: Pattern Recognition (ICPR), 2016 23rd International Conference on. IEEE: 2016. p. 343–8.
41.
go back to reference Kuusisto F, Dutra I, Elezaby M, Mendonça EA, Shavlik J, Burnside ES. Leveraging expert knowledge to improve machine-learned decision support systems. AMIA Summits Transl Sci Proc. 2015; 2015:87.PubMed Kuusisto F, Dutra I, Elezaby M, Mendonça EA, Shavlik J, Burnside ES. Leveraging expert knowledge to improve machine-learned decision support systems. AMIA Summits Transl Sci Proc. 2015; 2015:87.PubMed
44.
go back to reference Bishop CM. Pattern Recognition and Machine Learning. Dordrecht: Springer; 2006. Bishop CM. Pattern Recognition and Machine Learning. Dordrecht: Springer; 2006.
45.
go back to reference Spackman KA, Campbell KE, Côté RA. SNOMED RT: a reference terminology for health care. In: Proceedings of the AMIA annual fall symposium: 1997. p. 640. Spackman KA, Campbell KE, Côté RA. SNOMED RT: a reference terminology for health care. In: Proceedings of the AMIA annual fall symposium: 1997. p. 640.
46.
go back to reference Yang J, Honavar V. Feature subset selection using a genetic algorithm. IEEE Intell Syst Appl. 1998; 13(2):44–49.CrossRef Yang J, Honavar V. Feature subset selection using a genetic algorithm. IEEE Intell Syst Appl. 1998; 13(2):44–49.CrossRef
47.
go back to reference Nickel M, Murphy K, Tresp V, Gabrilovich E. A review of relational machine learning for knowledge graphs. Proc IEEE. 2016; 104(1):11–33.CrossRef Nickel M, Murphy K, Tresp V, Gabrilovich E. A review of relational machine learning for knowledge graphs. Proc IEEE. 2016; 104(1):11–33.CrossRef
48.
go back to reference Vishwanathan SVN, Schraudolph NN, Kondor R, Borgwardt KM. Graph kernels. J Mach Learn Res. 2010; 11(Apr):1201–42. Vishwanathan SVN, Schraudolph NN, Kondor R, Borgwardt KM. Graph kernels. J Mach Learn Res. 2010; 11(Apr):1201–42.
49.
go back to reference Lösch U, Bloehdorn S, Rettinger A. Graph kernels for RDF data. Semant Web Res Appl. 2012; 7295:134–148.CrossRef Lösch U, Bloehdorn S, Rettinger A. Graph kernels for RDF data. Semant Web Res Appl. 2012; 7295:134–148.CrossRef
50.
go back to reference de Vries GK. A fast approximation of the Weisfeiler-Lehman graph kernel for RDF data. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Dordrecht: Springer: 2013. p. 606–21. de Vries GK. A fast approximation of the Weisfeiler-Lehman graph kernel for RDF data. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Dordrecht: Springer: 2013. p. 606–21.
51.
go back to reference He H, Garcia EA. Learning from imbalanced data. IEEE Trans Knowl Data Eng. 2009; 21(9):1263–84.CrossRef He H, Garcia EA. Learning from imbalanced data. IEEE Trans Knowl Data Eng. 2009; 21(9):1263–84.CrossRef
52.
go back to reference Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. Smote: synthetic minority over-sampling technique. J Artif Intell Res. 2002; 16:321–57.CrossRef Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. Smote: synthetic minority over-sampling technique. J Artif Intell Res. 2002; 16:321–57.CrossRef
53.
go back to reference He H, Bai Y, Garcia EA, Li S. Adasyn: Adaptive synthetic sampling approach for imbalanced learning. In: Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE International Joint Conference on. New Jersey: IEEE: 2008. p. 1322–8. He H, Bai Y, Garcia EA, Li S. Adasyn: Adaptive synthetic sampling approach for imbalanced learning. In: Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE International Joint Conference on. New Jersey: IEEE: 2008. p. 1322–8.
54.
go back to reference Ribeiro MT, Singh S, Guestrin C. Why should i trust you?: Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM: 2016. p. 1135–44. Ribeiro MT, Singh S, Guestrin C. Why should i trust you?: Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM: 2016. p. 1135–44.
55.
go back to reference Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. In: Advances in Neural Information Processing Systems: 2017. p. 4765–4774. Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. In: Advances in Neural Information Processing Systems: 2017. p. 4765–4774.
56.
go back to reference Vidovic MM-C, Görnitz N, Müller K-R, Kloft M. Feature importance measure for non-linear learning algorithms. arXiv preprint arXiv:1611.07567. 2016. Vidovic MM-C, Görnitz N, Müller K-R, Kloft M. Feature importance measure for non-linear learning algorithms. arXiv preprint arXiv:1611.07567. 2016.
59.
go back to reference Çelik U, Yurtay N, Koç ER, Tepe N, Güllüoğlu H, Ertaş M. Diagnostic accuracy comparison of artificial immune algorithms for primary headaches. Comput Math Methods Med. 2015;2015. Çelik U, Yurtay N, Koç ER, Tepe N, Güllüoğlu H, Ertaş M. Diagnostic accuracy comparison of artificial immune algorithms for primary headaches. Comput Math Methods Med. 2015;2015.
62.
go back to reference Breiman L, Friedman J, Olshen R, Stone C. Classification and Regression Trees. Monterey: Wadsworth and Brooks; 1984. Breiman L, Friedman J, Olshen R, Stone C. Classification and Regression Trees. Monterey: Wadsworth and Brooks; 1984.
63.
go back to reference Quinlan JR. C4.5: Programs for Machine Learning. San Francisco: Morgan Kaufmann Publishers Inc.; 1993. Quinlan JR. C4.5: Programs for Machine Learning. San Francisco: Morgan Kaufmann Publishers Inc.; 1993.
64.
go back to reference Demšar J, Curk T, Erjavec A, Gorup Č, Hočevar T, Milutinovič M, Možina M, Polajnar M, Toplak M, Starič A, et al. Orange: data mining toolbox in python. J Mach Learn Res. 2013; 14(1):2349–53. Demšar J, Curk T, Erjavec A, Gorup Č, Hočevar T, Milutinovič M, Možina M, Polajnar M, Toplak M, Starič A, et al. Orange: data mining toolbox in python. J Mach Learn Res. 2013; 14(1):2349–53.
65.
go back to reference Vandewiele G, Lannoye K, Janssens O, Ongenae F, De Turck F, Van Hoecke S. A genetic algorithm for interpretable model extraction from decision tree ensembles. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer: 2017. p. 104–115. Vandewiele G, Lannoye K, Janssens O, Ongenae F, De Turck F, Van Hoecke S. A genetic algorithm for interpretable model extraction from decision tree ensembles. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer: 2017. p. 104–115.
66.
go back to reference Breiman L. Random Forests. Mach Learn. 1999; 45(5):1–35. Breiman L. Random Forests. Mach Learn. 1999; 45(5):1–35.
67.
go back to reference Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. ACM: 2016. p. 785–794. Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. ACM: 2016. p. 785–794.
68.
go back to reference Dietterich TG, et al. Ensemble methods in machine learning. Mult Classifier Syst. 2000; 1857:1–15.CrossRef Dietterich TG, et al. Ensemble methods in machine learning. Mult Classifier Syst. 2000; 1857:1–15.CrossRef
69.
go back to reference Esposito F, Malerba D, Semeraro G, Kay J. A comparative analysis of methods for pruning decision trees. IEEE Trans Pattern Anal Mach Intell. 1997; 19(5):476–91.CrossRef Esposito F, Malerba D, Semeraro G, Kay J. A comparative analysis of methods for pruning decision trees. IEEE Trans Pattern Anal Mach Intell. 1997; 19(5):476–91.CrossRef
71.
go back to reference Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960; 20(1):37–46.CrossRef Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960; 20(1):37–46.CrossRef
73.
go back to reference Martin VT. The diagnostic evaluation of secondary headache disorders. Headache J Head Face Pain. 2011; 51(2):346–52.CrossRef Martin VT. The diagnostic evaluation of secondary headache disorders. Headache J Head Face Pain. 2011; 51(2):346–52.CrossRef
74.
go back to reference Lehmann J, Sejdiu G, Bühmann L, Westphal P, Stadler C, Ermilov I, Bin S, Chakraborty N, Saleem M, Ngomo A-CN, et al. Distributed semantic analytics using the sansa stack. In: International Semantic Web Conference. Dordrecht: Springer: 2017. p. 147–55. Lehmann J, Sejdiu G, Bühmann L, Westphal P, Stadler C, Ermilov I, Bin S, Chakraborty N, Saleem M, Ngomo A-CN, et al. Distributed semantic analytics using the sansa stack. In: International Semantic Web Conference. Dordrecht: Springer: 2017. p. 147–55.
Metadata
Title
A decision support system to follow up and diagnose primary headache patients using semantically enriched data
Authors
Gilles Vandewiele
Femke De Backere
Kiani Lannoye
Maarten Vanden Berghe
Olivier Janssens
Sofie Van Hoecke
Vincent Keereman
Koen Paemeleire
Femke Ongenae
Filip De Turck
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2018
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-018-0679-6

Other articles of this Issue 1/2018

BMC Medical Informatics and Decision Making 1/2018 Go to the issue