An EMG foundation model for neural decoding
Kurbis, A. G.; Mihailidis, A.; Laschowski, B.
Show abstract
Decoding algorithms can be used to predict motor behaviour from patterns of neural activity. However, most studies rely on subject-optimized models, limiting generalization and scalability to novel subjects and tasks. Building on recent advances in deep learning and large-scale data, here we developed an EMG foundation model for neural decoding. Our model was trained on more than 197 hours of neural recordings from 1,667 subjects. We used unsupervised learning to pretrain our encoder layers on unlabeled data, followed by supervised learning on our benchmark dataset. Additionally, we performed large-scale architecture searches to develop a custom encoder-decoder model composed of convolutional and transformer layers, optimized for both scalability and performance. Our foundation model consistently outperformed the previous state-of-the-art (i.e., subject-optimized models) across both in-distribution and out-of-distribution evaluations. For in-distribution evaluation, few-shot fine-tuning yielded an average F1 score of 0.697, compared to 0.638 for subject-optimized models. For out-of-distribution evaluation on clinical and demographically-shifted subjects, we achieved an average F1 score of 0.599, compared to 0.518 for the subject-optimized baselines. Taken together, our results highlight the value of foundation models for robust and generalizable neural decoding. By publicly releasing our neural network weights and training pipeline, we aim to support future research in computational neuroscience and neural-machine interfaces.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Learning neural decoders without labels using multiple data streams 97%
- Unsupervised, piecewise linear decoding enables an accurate prediction of muscle activity in a multi-task brain computer interface 95%
- Robust and accurate decoding of hand kinematics from entire spiking activity using deep learning 93%
Similar papers in this journal
Similar papers in this journal
- Stabilizing brain-computer interfaces through alignment of latent dynamics 94%
- Real-Time Brain-Machine Interface Achieves High-Velocity Prosthetic Finger Movements using a Biologically-Inspired Neural Network Decoder 92%
- CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells 92%
Similar papers in this journal
- CNN MouseNet: A biologically constrained convolutional neural network model for mouse visual cortex 94%
- Increasing neural network robustness improves match to macaque V1 eigenspectrum, spatial frequency preference and predictivity 93%
- How well do models of visual cortex generalize to out of distribution samples? 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.