Skip to main content
Top
Published in: BMC Medicine 1/2018

Open Access 01-12-2018 | Research article

Recurrence quantification analysis of resting state EEG signals in autism spectrum disorder – a systematic methodological exploration of technical and demographic confounders in the search for biomarkers

Authors: T. Heunis, C. Aldrich, J. M. Peters, S. S. Jeste, M. Sahin, C. Scheffer, P. J. de Vries

Published in: BMC Medicine | Issue 1/2018

Login to get access

Abstract

Background

Autism spectrum disorder (ASD) is a neurodevelopmental disorder with a worldwide prevalence of 1–2%. In low-resource environments, in particular, early identification and diagnosis is a significant challenge. Therefore, there is a great demand for ‘language-free, culturally fair’ low-cost screening tools for ASD that do not require highly trained professionals. Electroencephalography (EEG) has seen growing interest as an investigational tool for biomarker development in ASD and neurodevelopmental disorders. One of the key challenges is the identification of appropriate multivariate, next-generation analytical methodologies that can characterise the complex, nonlinear dynamics of neural networks in the brain, mindful of technical and demographic confounders that may influence biomarker findings. The aim of this study was to evaluate the robustness of recurrence quantification analysis (RQA) as a potential biomarker for ASD using a systematic methodological exploration of a range of potential technical and demographic confounders.

Methods

RQA feature extraction was performed on continuous 5-second segments of resting state EEG (rsEEG) data and linear and nonlinear classifiers were tested. Data analysis progressed from a full sample of 16 ASD and 46 typically developing (TD) individuals (age 0–18 years, 4802 EEG segments), to a subsample of 16 ASD and 19 TD children (age 0–6 years, 1874 segments), to an age-matched sample of 7 ASD and 7 TD children (age 2–6 years, 666 segments) to prevent sample bias and to avoid misinterpretation of the classification results attributable to technical and demographic confounders. A clinical scenario of diagnosing an unseen subject was simulated using a leave-one-subject-out classification approach.

Results

In the age-matched sample, leave-one-subject-out classification with a nonlinear support vector machine classifier showed 92.9% accuracy, 100% sensitivity and 85.7% specificity in differentiating ASD from TD. Age, sex, intellectual ability and the number of training and test segments per group were identified as possible demographic and technical confounders. Consistent repeatability, i.e. the correct identification of all segments per subject, was found to be a challenge.

Conclusions

RQA of rsEEG was an accurate classifier of ASD in an age-matched sample, suggesting the potential of this approach for global screening in ASD. However, this study also showed experimentally how a range of technical challenges and demographic confounders can skew results, and highlights the importance of probing for these in future studies. We recommend validation of this methodology in a large and well-matched sample of infants and children, preferably in a low- and middle-income setting.
Literature
1.
go back to reference Walsh P, Elsabbagh M, Bolton P, Singh I. In search of biomarkers for autism: scientific, social and ethical challenges. Nat Rev Neurosci. 2011;12:603–12.CrossRefPubMed Walsh P, Elsabbagh M, Bolton P, Singh I. In search of biomarkers for autism: scientific, social and ethical challenges. Nat Rev Neurosci. 2011;12:603–12.CrossRefPubMed
2.
go back to reference Jeste SS, Frohlich J, Loo SK. Electrophysiological biomarkers of diagnosis and outcome in neurodevelopmental disorders. Curr Opin Neurol. 2015;28:110–6.CrossRefPubMed Jeste SS, Frohlich J, Loo SK. Electrophysiological biomarkers of diagnosis and outcome in neurodevelopmental disorders. Curr Opin Neurol. 2015;28:110–6.CrossRefPubMed
3.
go back to reference Heunis T, Aldrich C, de Vries PJ. Recent advances in resting-state electroencephalography biomarkers for autism Spectrum disorder-a review of methodological and clinical challenges. Pediatr Neurol. 2016;61:28–37.CrossRefPubMed Heunis T, Aldrich C, de Vries PJ. Recent advances in resting-state electroencephalography biomarkers for autism Spectrum disorder-a review of methodological and clinical challenges. Pediatr Neurol. 2016;61:28–37.CrossRefPubMed
4.
go back to reference Baird G, Simonoff E, Pickles A, Chandler S, Loucas T, Meldrum D, Charman T. Prevalence of disorders of the autism spectrum in a population cohort of children in South Thames: the special needs and autism project (SNAP). Lancet. 2006;368:210–5.CrossRefPubMed Baird G, Simonoff E, Pickles A, Chandler S, Loucas T, Meldrum D, Charman T. Prevalence of disorders of the autism spectrum in a population cohort of children in South Thames: the special needs and autism project (SNAP). Lancet. 2006;368:210–5.CrossRefPubMed
5.
go back to reference Kim YS, Leventhal BL, Koh Y, Fembonne E, Laska E, Lim E, Cheon K, Kim S, Kim Y, Lee H, et al. Prevalence of autism spectrum disorders in a total population sample. Am J Psychiatr. 2011;168:904–12.CrossRefPubMed Kim YS, Leventhal BL, Koh Y, Fembonne E, Laska E, Lim E, Cheon K, Kim S, Kim Y, Lee H, et al. Prevalence of autism spectrum disorders in a total population sample. Am J Psychiatr. 2011;168:904–12.CrossRefPubMed
6.
go back to reference Elsabbagh M, Divan G, Koh YJ, Kim YS, Kauchali S, Marcín C, Montiel-Nava C, Patel V, Paula CS, Wang C, et al. Global prevalence of autism and other pervasive developmental disorders. Autism Res. 2012;5:160–79.CrossRefPubMedPubMedCentral Elsabbagh M, Divan G, Koh YJ, Kim YS, Kauchali S, Marcín C, Montiel-Nava C, Patel V, Paula CS, Wang C, et al. Global prevalence of autism and other pervasive developmental disorders. Autism Res. 2012;5:160–79.CrossRefPubMedPubMedCentral
7.
go back to reference American Psychiatric Association. DSM-5 Task Force. Diagnostic and Statistical Manual of Mental Disorders: DSM-5. 5th ed. Washington, D.C.: American Psychiatric Publishing; 2013.CrossRef American Psychiatric Association. DSM-5 Task Force. Diagnostic and Statistical Manual of Mental Disorders: DSM-5. 5th ed. Washington, D.C.: American Psychiatric Publishing; 2013.CrossRef
8.
go back to reference Developmental Disabilities Monitoring Network Surveillance Year 2010 Principal Investigators, Centers for Disease Control and Prevention. Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring networks, 11 sites, United States, 2010. MMWR Surveill Summ. 2014;63:1–21. Developmental Disabilities Monitoring Network Surveillance Year 2010 Principal Investigators, Centers for Disease Control and Prevention. Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring networks, 11 sites, United States, 2010. MMWR Surveill Summ. 2014;63:1–21.
9.
go back to reference Tomlinson M, Swartz L. Imbalances in the knowledge about infancy: the divide between rich and poor countries. Infant Mental Health J. 2003;24:547–56.CrossRef Tomlinson M, Swartz L. Imbalances in the knowledge about infancy: the divide between rich and poor countries. Infant Mental Health J. 2003;24:547–56.CrossRef
10.
go back to reference de Vries PJ. Thinking globally to meet local needs: autism spectrum disorders in Africa and other low-resource environments. Curr Opin Neurol. 2016;29:130–6.CrossRefPubMed de Vries PJ. Thinking globally to meet local needs: autism spectrum disorders in Africa and other low-resource environments. Curr Opin Neurol. 2016;29:130–6.CrossRefPubMed
11.
go back to reference Franz L, Chambers N, von Isenburg M, de Vries PJ. Autism spectrum disorder in sub-Saharan Africa: a comprehensive scoping review. Autism Res. 2017;10:723–49.CrossRefPubMedPubMedCentral Franz L, Chambers N, von Isenburg M, de Vries PJ. Autism spectrum disorder in sub-Saharan Africa: a comprehensive scoping review. Autism Res. 2017;10:723–49.CrossRefPubMedPubMedCentral
12.
go back to reference Crane JL, Winsler A. Early autism detection: implications for pediatric practice and public policy. J Disability Policy Studies. 2008;18:245–53.CrossRef Crane JL, Winsler A. Early autism detection: implications for pediatric practice and public policy. J Disability Policy Studies. 2008;18:245–53.CrossRef
13.
go back to reference Duffy FH, Als H. A stable pattern of EEG spectral coherence distinguishes children with autism from neuro-typical controls - a large case control study. BMC Med. 2012;10:64.CrossRefPubMedPubMedCentral Duffy FH, Als H. A stable pattern of EEG spectral coherence distinguishes children with autism from neuro-typical controls - a large case control study. BMC Med. 2012;10:64.CrossRefPubMedPubMedCentral
14.
go back to reference van Tongerloo MA, Bor HH, Lagro-Janssen AL. Detecting autism spectrum disorders in the general practitioner's practice. J Autism Dev Disord. 2012;42:1531–8.CrossRefPubMed van Tongerloo MA, Bor HH, Lagro-Janssen AL. Detecting autism spectrum disorders in the general practitioner's practice. J Autism Dev Disord. 2012;42:1531–8.CrossRefPubMed
15.
go back to reference Voos AC, Pelphrey KA, Tirrell J, Bolling DZ, Vander Wyk B, Kaiser MD, McPartland JC, Volkmar FR, Ventola P. Neural mechanisms of improvements in social motivation after pivotal response treatment: two case studies. J Autism Dev Disord. 2013;43:1–10.CrossRefPubMedPubMedCentral Voos AC, Pelphrey KA, Tirrell J, Bolling DZ, Vander Wyk B, Kaiser MD, McPartland JC, Volkmar FR, Ventola P. Neural mechanisms of improvements in social motivation after pivotal response treatment: two case studies. J Autism Dev Disord. 2013;43:1–10.CrossRefPubMedPubMedCentral
16.
go back to reference Robins DL, Fein D, Barton ML, Green JA. The modified checklist for autism in toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord. 2001;31:131–44.CrossRefPubMed Robins DL, Fein D, Barton ML, Green JA. The modified checklist for autism in toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord. 2001;31:131–44.CrossRefPubMed
17.
go back to reference Johnson CP, Myers SM, American Academy of Pediatrics Council on Children with Disabilities. Identification and evaluation of children with autism spectrum disorders. Pediatrics. 2007;120:1183–215.CrossRefPubMed Johnson CP, Myers SM, American Academy of Pediatrics Council on Children with Disabilities. Identification and evaluation of children with autism spectrum disorders. Pediatrics. 2007;120:1183–215.CrossRefPubMed
18.
go back to reference Kleinman JM, Robins DL, Ventola PE, Pandey J, Boorstein HC, Esser EL, Wilson LB, Rosenthal MA, Sutera S, Verbalis AD, et al. The modified checklist for autism in toddlers: a follow-up study investigating the early detection of autism spectrum disorders. J Autism Dev Disord. 2008;38:827–39.CrossRefPubMedPubMedCentral Kleinman JM, Robins DL, Ventola PE, Pandey J, Boorstein HC, Esser EL, Wilson LB, Rosenthal MA, Sutera S, Verbalis AD, et al. The modified checklist for autism in toddlers: a follow-up study investigating the early detection of autism spectrum disorders. J Autism Dev Disord. 2008;38:827–39.CrossRefPubMedPubMedCentral
19.
go back to reference Durkin MS, Elsabbagh M, Barbaro J, Gladstone M, Happe F, Hoekstra RA, Lee LC, Rattazzi A, Stapel-Wax J, Stone WL, et al. Autism screening and diagnosis in low resource settings: challenges and opportunities to enhance research and services worldwide. Autism Res. 2015;8:473–6.CrossRefPubMedPubMedCentral Durkin MS, Elsabbagh M, Barbaro J, Gladstone M, Happe F, Hoekstra RA, Lee LC, Rattazzi A, Stapel-Wax J, Stone WL, et al. Autism screening and diagnosis in low resource settings: challenges and opportunities to enhance research and services worldwide. Autism Res. 2015;8:473–6.CrossRefPubMedPubMedCentral
20.
go back to reference Natarajan A, Acharya UR, Alias F, Tiboleng T, Puthusserpady SK. Nonlinear analysis of EEG signals at different mental states. J Biomed Eng Online. 2004;3:7.CrossRef Natarajan A, Acharya UR, Alias F, Tiboleng T, Puthusserpady SK. Nonlinear analysis of EEG signals at different mental states. J Biomed Eng Online. 2004;3:7.CrossRef
21.
go back to reference Acharya UR, Sree SV, Chattopadhyay S, Yu W, ANG PCA. Application of recurrence quantification analysis for the automated identification of epileptic EEG signals. Int J Neural Syst. 2011;21:199–211.CrossRefPubMed Acharya UR, Sree SV, Chattopadhyay S, Yu W, ANG PCA. Application of recurrence quantification analysis for the automated identification of epileptic EEG signals. Int J Neural Syst. 2011;21:199–211.CrossRefPubMed
23.
go back to reference Pistorius T, Aldrich C, Auret L, Pineda J. Early detection of risk of autism spectrum disorder based on recurrence quantification analysis of electroencephalographic signals. In: IEEE, 6th International IEEE/EMBS Conference on Neural Engineering (NER). San Diego: IEEE; 2013. p. 198–201. https://ieeexplore.ieee.org/document/6695906/. Accessed 30 Nov 2015. Pistorius T, Aldrich C, Auret L, Pineda J. Early detection of risk of autism spectrum disorder based on recurrence quantification analysis of electroencephalographic signals. In: IEEE, 6th International IEEE/EMBS Conference on Neural Engineering (NER). San Diego: IEEE; 2013. p. 198–201. https://​ieeexplore.​ieee.​org/​document/​6695906/​. Accessed 30 Nov 2015.
25.
go back to reference Schinkel S, Dimigen O, Marwan N. Selection of recurrence threshold for signal detection. Eur Phys J Special Topics. 2008;164:45–53.CrossRef Schinkel S, Dimigen O, Marwan N. Selection of recurrence threshold for signal detection. Eur Phys J Special Topics. 2008;164:45–53.CrossRef
26.
go back to reference Song IH, Lee DS, Kim SI. Recurrence quantification analysis of sleep electoencephalogram in sleep apnea syndrome in humans. Neurosci Lett. 2004;366:148–53.CrossRefPubMed Song IH, Lee DS, Kim SI. Recurrence quantification analysis of sleep electoencephalogram in sleep apnea syndrome in humans. Neurosci Lett. 2004;366:148–53.CrossRefPubMed
27.
go back to reference Becker K, Schneider G, Eder M, Ranft A, Kochs EF, Zieglgänsberger W, Dodt HU. Anaesthesia monitoring by recurrence quantification analysis of EEG data. PLoS One. 2010;5:e8876.CrossRefPubMedPubMedCentral Becker K, Schneider G, Eder M, Ranft A, Kochs EF, Zieglgänsberger W, Dodt HU. Anaesthesia monitoring by recurrence quantification analysis of EEG data. PLoS One. 2010;5:e8876.CrossRefPubMedPubMedCentral
28.
go back to reference Bhat S, Acharya UR, Adeli H, Bairy GM, Adeli A. Automated diagnosis of autism: in search of a mathematical marker. Rev Neurosci. 2014;25:851–61.PubMed Bhat S, Acharya UR, Adeli H, Bairy GM, Adeli A. Automated diagnosis of autism: in search of a mathematical marker. Rev Neurosci. 2014;25:851–61.PubMed
29.
go back to reference Marwan N, Romano MC, Thiel M, Kurths J. Recurrence plots for the analysis of complex systems. Phys Rep. 2007;438:237–329.CrossRef Marwan N, Romano MC, Thiel M, Kurths J. Recurrence plots for the analysis of complex systems. Phys Rep. 2007;438:237–329.CrossRef
30.
go back to reference Peters JM, Taquet M, Vega C, Jeste SS, Fernández IS, Tan J, Nelson CA, Sahin M, Warfield SK. Brain functional networks in syndromic and non-syndromic autism: a graph theoretical study of EEG connectivity. BMC Med. 2013;11:54.CrossRefPubMedPubMedCentral Peters JM, Taquet M, Vega C, Jeste SS, Fernández IS, Tan J, Nelson CA, Sahin M, Warfield SK. Brain functional networks in syndromic and non-syndromic autism: a graph theoretical study of EEG connectivity. BMC Med. 2013;11:54.CrossRefPubMedPubMedCentral
31.
go back to reference Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004;134:9–21.CrossRefPubMed Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004;134:9–21.CrossRefPubMed
32.
go back to reference Takens F. Detecting strange attractors in turbulence. Lecture Notes in Mathematics. 1981;898:366–81.CrossRef Takens F. Detecting strange attractors in turbulence. Lecture Notes in Mathematics. 1981;898:366–81.CrossRef
33.
go back to reference Aldrich C. Exploratory analysis of metallurgical process data with neural networks and related methods. The Netherlands: Elsevier; 2002. Aldrich C. Exploratory analysis of metallurgical process data with neural networks and related methods. The Netherlands: Elsevier; 2002.
34.
go back to reference Barnard J, Aldrich C. Quick-Ident Toolbox. Stellenbosch: Centre of Process Monitoring; 2002. Barnard J, Aldrich C. Quick-Ident Toolbox. Stellenbosch: Centre of Process Monitoring; 2002.
35.
go back to reference Bosl WL, Loddenkemper T, Nelson CA. Nonlinear EEG biomarker profiles for autism and absence epilepsy. Neuropsychiatric Electrophysiology. 2017;3:1.CrossRef Bosl WL, Loddenkemper T, Nelson CA. Nonlinear EEG biomarker profiles for autism and absence epilepsy. Neuropsychiatric Electrophysiology. 2017;3:1.CrossRef
36.
Metadata
Title
Recurrence quantification analysis of resting state EEG signals in autism spectrum disorder – a systematic methodological exploration of technical and demographic confounders in the search for biomarkers
Authors
T. Heunis
C. Aldrich
J. M. Peters
S. S. Jeste
M. Sahin
C. Scheffer
P. J. de Vries
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2018
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-018-1086-7

Other articles of this Issue 1/2018

BMC Medicine 1/2018 Go to the issue