Top

Journal of Neurology

Published in:

Open Access 01-12-2020 | Vestibular Migraine | Original Communication

Development and validation of a classification algorithm to diagnose and differentiate spontaneous episodic vertigo syndromes: results from the DizzyReg patient registry

Authors: Michael Groezinger, Doreen Huppert, Ralf Strobl, Eva Grill

Published in: Journal of Neurology | Special Issue 1/2020

Abstract

Background

Spontaneous episodic vertigo syndromes, namely vestibular migraine (VM) and Menière’s disease (MD), are difficult to differentiate, even for an experienced clinician. In the presence of complex diagnostic information, automated systems can support human decision making. Recent developments in machine learning might facilitate bedside diagnosis of VM and MD.

Methods

Data of this study originate from the prospective patient registry of the German Centre for Vertigo and Balance Disorders, a specialized tertiary treatment center at the University Hospital Munich. The classification task was to differentiate cases of VM, MD from other vestibular disease entities. Deep Neural Networks (DNN) and Boosted Decision Trees (BDT) were used for classification.

Results

A total of 1357 patients were included (mean age 52.9, SD 15.9, 54.7% female), 9.9% with MD and 15.6% with VM. DNN models yielded an accuracy of 98.4 ± 0.5%, a precision of 96.3 ± 3.9%, and a sensitivity of 85.4 ± 3.9% for VM, and an accuracy of 98.0 ± 1.0%, a precision of 90.4 ± 6.2% and a sensitivity of 89.9 ± 4.6% for MD. BDT yielded an accuracy of 84.5 ± 0.5%, precision of 51.8 ± 6.1%, sensitivity of 16.9 ± 1.7% for VM, and an accuracy of 93.3 ± 0.7%, precision 76.0 ± 6.7%, sensitivity 41.7 ± 2.9% for MD.

Conclusion

The correct diagnosis of spontaneous episodic vestibular syndromes is challenging in clinical practice. Modern machine learning methods might be the basis for developing systems that assist practitioners and clinicians in their daily treatment decisions.

Available only for authorised users

Neuhauser HK, Radtke A, von Brevern M, Feldmann M, Lezius F, Ziese T, Lempert T (2006) Migrainous vertigo: prevalence and impact on quality of life. Neurology 67(6):1028–1033. https://doi.org/10.1212/01.wnl.0000237539.09942.06CrossRefPubMed

Brandt T, Dieterich M (2017) The dizzy patient: don’t forget disorders of the central vestibular system. Nat Rev Neurol 13(6):352–362. https://doi.org/10.1038/nrneurol.2017.58CrossRefPubMed

Cohen JM, Bigal ME, Newman LC (2011) Migraine and vestibular symptoms–identifying clinical features that predict “vestibular migraine”. Headache 51(9):1393–1397. https://doi.org/10.1111/j.1526-4610.2011.01934.xCrossRefPubMed

Cutrer FM, Baloh RW (1992) Migraine-associated dizziness. Headache 32(6):300–304. https://doi.org/10.1111/j.1526-4610.1992.hed3206300.xCrossRefPubMed

Dieterich M, Brandt T (1999) Episodic vertigo related to migraine (90 cases): vestibular migraine? J Neurol 246(10):883–892. https://doi.org/10.1007/s004150050478CrossRefPubMed

Furman JM, Balaban CD (2015) Vestibular migraine. Ann NY Acad Sci 1343:90–96. https://doi.org/10.1111/nyas.12645CrossRefPubMed

Furman JM, Marcus DA, Balaban CD (2013) Vestibular migraine: clinical aspects and pathophysiology. Lancet Neurol 12(7):706–715. https://doi.org/10.1016/S1474-4422(13)70107-8CrossRefPubMed

Kayan A, Hood JD (1984) Neuro-otological manifestations of migraine. Brain 107(Pt 4):1123–1142. https://doi.org/10.1093/brain/107.4.1123CrossRefPubMed

O'Connell Ferster AP, Priesol AJ, Isildak H (2017) The clinical manifestations of vestibular migraine: a review. Auris Nasus Larynx 44(3):249–252. https://doi.org/10.1016/j.anl.2017.01.014CrossRefPubMed

10.

Strupp M, Versino M, Brandt T (2010) Vestibular migraine. Handb Clin Neurol 97:755–771. https://doi.org/10.1016/S0072-9752(10)97062-0CrossRefPubMed

11.

Brandt T, Dieterich M, Strupp M (2013) Vertigo and dizziness: common complaints, 2nd edn. Springer, LondonCrossRef

12.

Lempert T, Olesen J, Furman J, Waterston J, Seemungal B, Carey J, Bisdorff A, Versino M, Evers S, Newman-Toker D (2012) Vestibular migraine: diagnostic criteria. J Vestib Res 22(4):167–172. https://doi.org/10.3233/VES-2012-0453CrossRefPubMed

13.

Lopez-Escamez JA, Carey J, Chung WH, Goebel JA, Magnusson M, Mandala M, Newman-Toker DE, Strupp M, Suzuki M, Trabalzini F, Bisdorff A, Classification Committee of the Barany S, Japan Society for Equilibrium R, European Academy of O, Neurotology, Equilibrium Committee of the American Academy of O-H, Neck S, Korean Balance S (2015) Diagnostic criteria for Meniere’s disease. J Vestib Res 25(1):1–7CrossRef

14.

Lopez-Escamez JA, Dlugaiczyk J, Jacobs J, Lempert T, Teggi R, von Brevern M, Bisdorff A (2014) Accompanying symptoms overlap during attacks in Meniere’s disease and vestibular migraine. Front Neurol 5:265. https://doi.org/10.3389/fneur.2014.00265CrossRefPubMedPubMedCentral

15.

Neff BA, Staab JP, Eggers SD, Carlson ML, Schmitt WR, Van Abel KM, Worthington DK, Beatty CW, Driscoll CL, Shepard NT (2012) Auditory and vestibular symptoms and chronic subjective dizziness in patients with Meniere's disease, vestibular migraine, and Meniere's disease with concomitant vestibular migraine. Otol Neurotol 33(7):1235–1244. https://doi.org/10.1097/MAO.0b013e31825d644aCrossRefPubMed

16.

Radtke A, Lempert T, Gresty MA, Brookes GB, Bronstein AM, Neuhauser H (2002) Migraine and Meniere’s disease: is there a link? Neurology 59(11):1700–1704. https://doi.org/10.1212/01.wnl.0000036903.22461.39CrossRefPubMed

17.

Goodfellow I, Bengio Y, Courville A (2016) Deep learning. The MIT Press, Cambridge, Massachusetts, Adaptive computation and machine learning

18.

Juhola M (2008) On machine learning classification of otoneurological data. Stud Health Technol Inform 136:211–216PubMed

19.

Varpa K, Joutsijoki H, Iltanen K, Juhola M (2011) Applying one-vs-one and one-vs-all classifiers in k-nearest neighbour method and support vector machines to an otoneurological multi-class problem. Stud Health Technol Inform 169:579–583PubMed

20.

Exarchos TP, Rigas G, Bibas A, Kikidis D, Nikitas C, Wuyts FL, Ihtijarevic B, Maes L, Cenciarini M, Maurer C, Macdonald N, Bamiou DE, Luxon L, Prasinos M, Spanoudakis G, Koutsouris DD, Fotiadis DI (2016) Mining balance disorders’ data for the development of diagnostic decision support systems. Comput Biol Med 77:240–248. https://doi.org/10.1016/j.compbiomed.2016.08.016CrossRefPubMed

21.

Priesol AJ, Cao M, Brodley CE, Lewis RF (2015) Clinical vestibular testing assessed with machine-learning algorithms. JAMA Otolaryngol Head Neck Surg 141(4):364–372. https://doi.org/10.1001/jamaoto.2014.3519CrossRefPubMed

22.

Aggarwal CC (2018) Neural networks and deep learning. Textbook. https://doi.org/10.1007/978-3-319-94463-0CrossRef

23.

Grill E, Muller T, Becker-Bense S, Gurkov R, Heinen F, Huppert D, Zwergal A, Strobl R (2017) DizzyReg: the prospective patient registry of the German center for vertigo and balance disorders. J Neurol 264(Suppl 1):34–36. https://doi.org/10.1007/s00415-017-8438-7CrossRefPubMed

24.

Grill E, Akdal G, Becker-Bense S, Hubinger S, Huppert D, Kentala E, Strobl R, Zwergal A, Celebisoy N (2018) Multicenter data banking in management of dizzy patients: first results from the dizzynet registry project. J Neurol 265(Suppl 1):3–8. https://doi.org/10.1007/s00415-018-8864-1CrossRefPubMed

25.

Lopez-Escamez JA, Carey J, Chung WH, Goebel JA, Magnusson M, Mandala M, Newman-Toker DE, Strupp M, Suzuki M, Trabalzini F, Bisdorff A (2016) [Diagnostic criteria for Meniere’s disease. Consensus document of the Barany Society, the Japan Society for Equilibrium Research, the European Academy of Otology and Neurotology (EAONO), the American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS) and the Korean Balance Society]. Acta Otorrinolaringol Esp 67(1):1–7. 10.1016/j.otorri.2015.05.005

26.

Luo W, Phung D, Tran T, Gupta S, Rana S, Karmakar C, Shilton A, Yearwood J, Dimitrova N, Ho TB, Venkatesh S, Berk M (2016) Guidelines for developing and reporting machine learning predictive models in biomedical research: a multidisciplinary view. J Med Internet Res 18(12):e323. https://doi.org/10.2196/jmir.5870CrossRefPubMedPubMedCentral

27.

Rousseau R (2018) The F-measure for research priority. J Data Infor Sci 3(1):1–18. https://doi.org/10.2478/jdis-2018-0001CrossRef

28.

Buuren Sv (2018) Flexible imputation of missing data. Chapman and Hall/CRC interdisciplinary statistics series, Second edition. edn. CRC Press, Taylor and Francis Group, Boca Raton

29.

van Buuren S, Groothuis-Oudshoorn K (2011) Mice: multivariate imputation by chained equations in R. J Stat Softw 1(3):2011

30.

SrivastavaGeoffrey NH, Krizhevsky, Alex, Sutskever, Ilya, Salakhutdinov, Ruslan (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learning Res 15:1929–1958

31.

Erhan D, Courville A, Bengio Y, Vincent P (2010) Why does unsupervised pre-training help deep learning? In: Yee Whye T, Mike T (eds) Proceedings of the thirteenth international conference on artificial intelligence and statistics. Proceedings of Machine Learning Research, PMLR, vol 9, pp 201–208

32.

Erhan D, Manzagol PA, Bengio Y, Bengio S, Vincent P (2009) The difficulty of training deep architectures and the effect of unsupervised pre-training. In: David van D, Max W (eds) Proceedings of the twelth international conference on artificial intelligence and statistics. Proceedings of Machine Learning Research, PMLR, vol 5, pp 153–160

33.

Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Yee Whye T, Mike T (eds) Proceedings of the thirteenth international conference on artificial intelligence and statistics. Proceedings of Machine Learning Research, PMLR vol 9, pp 249–256

34.

Hastie T, Tibshirani R, Friedman JH (2009) The elements of statistical learning: data mining, inference, and prediction. Springer series in statistics, 2nd edn. Springer, New York, NY

35.

Flach PA (2012) Machine learning : the art and science of algorithms that make sense of data. Cambridge University Press, Cambridge, New YorkCrossRef

36.

Neugebauer H, Adrion C, Glaser M, Strupp M (2013) Long-term changes of central ocular motor signs in patients with vestibular migraine. Eur Neurol 69(2):102–107. https://doi.org/10.1159/000343814CrossRefPubMed

37.

Radtke A, Neuhauser H, von Brevern M, Hottenrott T, Lempert T (2011) Vestibular migraine–validity of clinical diagnostic criteria. Cephalalgia 31(8):906–913. https://doi.org/10.1177/0333102411405228CrossRefPubMed

38.

Radtke A, von Brevern M, Neuhauser H, Hottenrott T, Lempert T (2012) Vestibular migraine: long-term follow-up of clinical symptoms and vestibulo-cochlear findings. Neurology 79(15):1607–1614. https://doi.org/10.1212/WNL.0b013e31826e264fCrossRefPubMed

39.

von Brevern M, Zeise D, Neuhauser H, Clarke AH, Lempert T (2005) Acute migrainous vertigo: clinical and oculographic findings. Brain 128(Pt 2):365–374. https://doi.org/10.1093/brain/awh351CrossRef

Title: Development and validation of a classification algorithm to diagnose and differentiate spontaneous episodic vertigo syndromes: results from the DizzyReg patient registry
Authors: Michael Groezinger
Doreen Huppert
Ralf Strobl
Eva Grill
Publication date: 01-12-2020
Publisher: Springer Berlin Heidelberg
Keyword: Vestibular Migraine
Published in: Journal of Neurology / Issue Special Issue 1/2020
Print ISSN: 0340-5354
Electronic ISSN: 1432-1459
DOI: https://doi.org/10.1007/s00415-020-10061-9

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Development and validation of a classification algorithm to diagnose and differentiate spontaneous episodic vertigo syndromes: results from the DizzyReg patient registry

Abstract

Background

Methods

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Special Issue 1/2020

Independent domains of daily mobility in patients with neurological gait disorders

Risk of acute brain lesions in dizzy patients presenting to the emergency room: who needs imaging and who does not?

The DizzyQuest: to have or not to have… a vertigo attack?

Body-maps of emotions in bilateral vestibulopathy

Different EEG brain activity in right and left handers during visually induced self-motion perception

Surgical techniques and functional evaluation for vestibular lesions in the mouse: unilateral labyrinthectomy (UL) and unilateral vestibular neurectomy (UVN)