EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classification Article Swipe

MAKE IMPACT

Yiyu Gui , M. M. CHEN , Yuqi Su , Guibo Luo , Yuchao Yang · YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2407.20254

In recent years, with the development of deep learning, electroencephalogram (EEG) classification networks have achieved certain progress. Transformer-based models can perform well in capturing long-term dependencies in EEG signals. However, their quadratic computational complexity poses a substantial computational challenge. Moreover, most EEG classification models are only suitable for single tasks and struggle with generalization across different tasks, particularly when faced with variations in signal length and channel count. In this paper, we introduce EEGMamba, the first universal EEG classification network to truly implement multi-task learning for EEG applications. EEGMamba seamlessly integrates the Spatio-Temporal-Adaptive (ST-Adaptive) module, bidirectional Mamba, and Mixture of Experts (MoE) into a unified framework. The proposed ST-Adaptive module performs unified feature extraction on EEG signals of different lengths and channel counts through spatial-adaptive convolution and incorporates a class token to achieve temporal-adaptability. Moreover, we design a bidirectional Mamba particularly suitable for EEG signals for further feature extraction, balancing high accuracy, fast inference speed, and efficient memory-usage in processing long EEG signals. To enhance the processing of EEG data across multiple tasks, we introduce task-aware MoE with a universal expert, effectively capturing both differences and commonalities among EEG data from different tasks. We evaluate our model on eight publicly available EEG datasets, and the experimental results demonstrate its superior performance in four types of tasks: seizure detection, emotion recognition, sleep stage classification, and motor imagery. The code is set to be released soon.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2407.20254

PDF

https://arxiv.org/pdf/2407.20254

OA Status

green

Cited By

1

Related Works

10

OpenAlex ID

https://openalex.org/W4401202694

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4401202694

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2407.20254

Digital Object Identifier

Title

EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classification

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2024

Year of publication

Publication date

2024-07-20

Full publication date if available

Authors

Yiyu Gui, M. M. CHEN, Yuqi Su, Guibo Luo, Yuchao Yang

List of authors in order

Landing page

https://arxiv.org/abs/2407.20254

Publisher landing page

PDF URL

https://arxiv.org/pdf/2407.20254

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2407.20254

Direct OA link when available

Concepts

Electroencephalography, Space (punctuation), Computer science, State (computer science), State space, Pattern recognition (psychology), Artificial intelligence, Mathematics, Psychology, Statistics, Algorithm, Neuroscience, Operating system

Top concepts (fields/topics) attached by OpenAlex

Cited by

1

Total citation count in OpenAlex

Citations by year (recent)

2025: 1

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload