FEMBA: Efficient and Scalable EEG Analysis with a Bidirectional Mamba Foundation Model
FEMBA Foundation ModelAbstract
FEMBA proposes a self-supervised EEG foundation model built on a bidirectional Mamba state-space architecture that scales linearly with sequence length and avoids the quadratic complexity of transformers. Trained on more than 21,000 hours of unlabeled EEG and fine-tuned on multiple downstream tasks, FEMBA reaches 81.82% balanced accuracy (AUROC 0.8921) on the TUAB dataset and 0.949 AUROC on TUAR, while a tiny 7.8M-parameter variant demonstrates suitability for resource-constrained devices.
Type
Key Highlights
- Bidirectional Mamba state-space architecture scales linearly with sequence length and avoids transformer quadratic complexity.
- Pre-trained on more than 21,000 hours of EEG data; achieves 81.82% balanced accuracy on TUAB and 0.949 AUROC on TUAR.
- Compact 7.8M-parameter variant is suitable for embedded devices and edge deployment.
Resources
Thorir Mar Ingolfsson
Postdoctoral Researcher
Making AI run on microwatts: I build foundation models for EEG, ECG, and other biosignals, and compress them until they run in real time on wearable devices, not in the cloud.