Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
The Journal of Headache and Pain
Published in: The Journal of Headache and Pain 1/2020

Open Access 01-12-2020 | Migraine | Research article

Validation of an algorithm for automated classification of migraine and tension-type headache attacks in an electronic headache diary

Authors: Aaron Roesch, Markus A Dahlem, Lars Neeb, Tobias Kurth

Published in: The Journal of Headache and Pain | Issue 1/2020

Login to get access

Abstract

Background

This study evaluates the accuracy of an automated classification tool of single attacks of the two major primary headache disorders migraine and tension-type headache used in an electronic headache diary.

Methods

One hundred two randomly selected reported headache attacks from an electronic headache-diary of patients using the medical app M-sense were classified by both a neurologist with specialisation in headache medicine and an algorithm, constructed based on the ICHD-3 criteria for migraine and tension-type headache. The level of agreement between the headache specialist and the algorithm was compared by using a kappa statistic. Cases of disagreement were analysed in a disagreement validity assessment.

Result

The neurologist and the algorithm classified migraines with aura (MA), migraines without aura (MO), tension-type headaches (TTH) and non-migraine or non-TTH events. Of the 102 headache reports, 86 cases were fully agreed on, and 16 cases not, making the level of agreement unweighted kappa 0.74 and representing a substantial level of agreement. Most cases of disagreement (12 out of 16) were due to inadvertent mistakes of the neurologist identified in the disagreement validity assessment. The second most common reason (3 out of 16) was insufficient information for classification by the neurologist.

Conclusions

The substantial level of agreement indicates that the classification tool is a valuable instrument for automated evaluation of electronic headache diaries, which can thereby support the diagnostic and therapeutic clinical processes. Based on this study’s results, additional diagnostic functionalities of primary headache management apps can be implemented. Finally, future research can use this classification algorithm for large scale database analysis for epidemiological studies.
Literature
1.
Katsarava Z, Mania M, Lampl C, Herberhold J, Steiner TJ (2018) Poor medical care for people with migraine in Europe – evidence from the Eurolight study. J Headache Pain 19(1):10CrossRef
2.
Stovner L, Hagen K, Jensen R, Katsarava Z, Lipton R, Scher A et al (2007) The global burden of headache: a documentation of headache prevalence and disability worldwide. Cephalalgia 27(3):193–210CrossRef
3.
Olesen J (2018) International classification of headache disorders. Lancet Neurol 17(5):396–397CrossRef
4.
Becker WJ (2017) The diagnosis and Management of Chronic Migraine in primary care. Headache 57(9):1471–1481CrossRef
5.
6.
Lipton RB, Serrano D, Holland S, Fanning KM, Reed ML, Buse DC (2013) Barriers to the diagnosis and treatment of migraine: effects of sex, income, and headache features. Headache 53(1):81–92CrossRef
7.
Dodick DW, Loder EW, Manack Adams A, Buse DC, Fanning KM, Reed ML et al (2016) Assessing barriers to chronic migraine consultation, diagnosis, and treatment: results from the chronic migraine epidemiology and outcomes (CaMEO) study. Headache 56(5):821–834CrossRef
8.
Phillip D, Lyngberg A, Jensen R (2007) Assessment of headache diagnosis. A comparative population study of a clinical interview with a diagnostic headache diary. Cephalalgia 27(1):1–8CrossRef
9.
Potter R, Probyn K, Bernstein C, Pincus T, Underwood M, Matharu M (2019) Diagnostic and classification tools for chronic headache disorders: a systematic review. Cephalalgia 39(6):761–784CrossRef
10.
Mosadeghi-Nik M, Askari MS, Fatehi F (2016) Mobile health (mHealth) for headache disorders: a review of the evidence base. J Telemed Telecare 22(8):472–477CrossRef
11.
Hundert AS, Huguet A, McGrath PJ, Stinson JN, Wheaton M (2014) Commercially available mobile phone headache diary apps: a systematic review. JMIR Mhealth Uhealth 2(3):e36CrossRef
12.
Dahlem MA, Roesch A, Neeb L, Kropp P, Dresler T (2018) What do migraine apps offer? MMW Fortschr Med 160(2):51–54CrossRef
13.
Minen MT, Stieglitz EJ, Sciortino R, Torous J (2018) Privacy issues in smartphone applications: an analysis of headache/migraine applications. Headache 58(7):1014–1027CrossRef
14.
Terhechte A (2018) Medizinische software/medical apps. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz 61(3):321–327CrossRef
15.
16.
McCaffery M, Mosby AB (1994) Pain: clinical manual for nursing practice Pain: clinical manual for nursing practice. Nurs Stand 9(11):55
17.
18.
Granella F, D'Alessandro R, Manzoni GC, Cerbo R, Colucci D'Amato C, Pini LA et al (1994) International headache society classification: interobserver reliability in the diagnosis of primary headaches. Cephalalgia 14(1):16–20CrossRef
19.
20.
Andrew ME, Penzien DB, Rains JC, Knowlton GE, McAnulty RD (1992) Development of a computer application for headache diagnosis: the headache diagnostic system. Int J Biomed Comput 31(1):17–24CrossRef
21.
De Simone R, Coppola G, Ranieri A, Bussone G, Cortelli P, D'Amico D et al (2007) Validation of AIDA Cefalee, a computer-assisted diagnosis database for the management of headache patients. Neurol Sci 28(Suppl 2):S213–S216CrossRef
22.
Sarchielli P, Pedini M, Coppola F, Rossi C, Baldi A, Corbelli I et al (2007) Application of the ICHD-II criteria to the diagnosis of primary chronic headaches via a computerized structured record. Headache 47:38–44CrossRef
23.
Dong Z, Yin Z, He M, Chen X, Lv X, Yu S (2014) Validation of a guideline-based decision support system for the diagnosis of primary headache disorders based on ICHD-3 beta. J Headache Pain 15:40CrossRef
24.
Maizels M, Wolfe WJ (2008) An expert system for headache diagnosis: the computerized headache assessment tool (CHAT). Headache 48(1):72–78PubMed
25.
26.
Celik U, Yurtay N (2017) An ant colony optimization algorithm-based classification for the diagnosis of primary headaches using a website questionnaire expert system. Turk J Electrical Eng Comput Sci 25:4200–4210CrossRef
27.
Eriksen MK, Thomsen LL, Olesen J (2005) The visual Aura rating scale (VARS) for migraine aura diagnosis. Cephalalgia 25(10):801–810CrossRef
28.
Russell MB, Rasmussen BK, Brennum J, Iversen HK, Jensen RA, Olesen J (1992) Presentation of a new instrument: the diagnostic headache diary. Cephalalgia 12(6):369–374CrossRef
29.
Paolo Martelletti TJS (2011) Handbook of headache - the use of diaries in the Management of Headache
30.
Nappi G, Jensen R, Nappi RE, Sances G, Torelli P, Olesen J (2006) Diaries and calendars for migraine. A review. Cephalalgia 26(8):905–916CrossRef
31.
Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR (2002) Patient non-compliance with paper diaries. BMJ 324(7347):1193–1194CrossRef
32.
Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR (2003) Patient compliance with paper and electronic diaries. Control Clin Trials 24(2):182–199CrossRef
33.
Luciani R, Carter D, Mannix L, Hemphill M, Diamond M, Cady R (2000) Prevention of migraine during prodrome with naratriptan. Cephalalgia 20(2):122–126CrossRef
34.
Houle TT, Turner DP, Golding AN, Porter JAH, Martin VT, Penzien DB et al (2017) Forecasting individual headache attacks using perceived stress: development of a multivariable prediction model for persons with episodic migraine. Headache 57(7):1041–1050CrossRef
35.
36.
Agarwal A, Ressler D, Snyder G (2015) The current and future state of companion diagnostics. Pharmgenomics Pers Med 8:99–110PubMedPubMedCentral
37.
Turner DP, Smitherman TA, Black AK, Penzien DB, Porter JA, Lofland KR et al (2015) Are migraine and tension-type headache diagnostic types or points on a severity continuum? An exploration of the latent taxometric structure of headache. Pain 156(7):1200–1207CrossRef
38.
Vargas BB (2008) Tension-type headache and migraine: two points on a continuum? Curr Pain Headache Rep 12(6):433–436CrossRef
39.
Bruehl S, Lofland KR, Semenchuk EM, Rokicki LA, Penzien DB (1999) Use of cluster analysis to validate IHS diagnostic criteria for migraine and tension-type headache. Headache 39(3):181–189CrossRef
40.
Tinsley A, Rothrock JF (2018) What are we missing in the diagnostic criteria for migraine? Curr Pain Headache Rep 22(12):84CrossRef
Metadata
Title
Validation of an algorithm for automated classification of migraine and tension-type headache attacks in an electronic headache diary
Authors
Aaron Roesch
Markus A Dahlem
Lars Neeb
Tobias Kurth
Publication date
01-12-2020
Publisher
Springer Milan
Published in
The Journal of Headache and Pain / Issue 1/2020
Print ISSN: 1129-2369
Electronic ISSN: 1129-2377
DOI
https://doi.org/10.1186/s10194-020-01139-w

Other articles of this Issue 1/2020

The Journal of Headache and Pain 1/2020 Go to the issue

Research article

Improvements across a range of patient-reported domains with fremanezumab treatment: results from a patient survey study

Review article

Persistent post-traumatic headache: a migrainous loop or not? The preclinical evidence

Research article

Influence of headache pain intensity and frequency on migraine-related disability in chronic migraine patients treated with OnabotulinumtoxinA

Research article

Time trends of major headache diagnoses and predictive factors. Data from three Nord-Trøndelag health surveys

Research article

Impact of galcanezumab on total pain burden: findings from phase 3 randomized, double-blind, placebo-controlled studies in patients with episodic or chronic migraine (EVOLVE-1, EVOLVE-2, and REGAIN trials)

Research article

ICHD-3 is significantly more specific than ICHD-3 beta for diagnosis of migraine with aura and with typical aura