A Simulation Framework for Benchmarking EEG-Based Brain Connectivity Estimation Methodologies

Due to its high temporal resolution, electroencephalography (EEG) is widely used to study functional and effective brain connectivity. Yet, there is currently a mismatch between the vastness of studies conducted and the degree to which the employed analyses are theoretically understood and empirically validated. We here provide a simulation framework that enables researchers to test their analysis pipelines on realistic pseudo-EEG data. We construct a minimal example of brain interaction, which we propose as a benchmark for assessing a methodology’s general eligibility for EEG-based connectivity estimation. We envision that this benchmark be extended in a collaborative effort to validate methods in more complex scenarios. Quantitative metrics are defined to assess a method’s performance in terms of source localization, connectivity detection and directionality estimation. All data and code needed for generating pseudo-EEG data, conducting source reconstruction and connectivity estimation using baseline methods from the literature, evaluating performance metrics, as well as plotting results, are made publicly available. While this article covers only EEG modeling, we will also provide a magnetoencephalography version of our framework online.