Back

Online internal speech decoding from single neurons in a human participant

Wandelt, S. K.; Bjanes, D.; Pejsa, K.; Lee, B.; Liu, C.; Andersen, R. A.

2022-11-05 neurology
10.1101/2022.11.02.22281775 medRxiv
Show abstract

Speech brain-machine interfaces (BMIs) translate brain signals into words or audio outputs, enabling communication for people having lost their speech abilities due to diseases or injury. While important advances in vocalized, attempted, and mimed speech decoding have been achieved, results for internal speech decoding are sparse, and have yet to achieve high functionality. Notably, it is still unclear from which brain areas internal speech can be decoded. In this work, a tetraplegic participant with implanted microelectrode arrays located in the supramarginal gyrus (SMG) and primary somatosensory cortex (S1) performed internal and vocalized speech of six words and two pseudowords. We found robust internal speech decoding from SMG single neuron activity, achieving up to 91% classification accuracy during an online task (chance level 12.5%). Evidence of shared neural representations between internal speech, word reading, and vocalized speech processes were found. SMG represented words in different languages (English/ Spanish) as well as pseudowords, providing evidence for phonetic encoding. Furthermore, our decoder achieved high classification with multiple internal speech strategies (auditory imagination/ visual imagination). Activity in S1 was modulated by vocalized but not internal speech, suggesting no articulator movements of the vocal tract occurred during internal speech production. This works represents the first proof-of-concept for a high-performance internal speech BMI.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Cerebral Cortex
396 papers in training set
Top 0.1%
21.7%
2
Neuron
337 papers in training set
Top 0.7%
9.4%
3
iScience
1154 papers in training set
Top 1%
6.5%
4
The Journal of Neuroscience
1025 papers in training set
Top 3%
5.4%
5
eLife
5828 papers in training set
Top 23%
5.3%
6
Nature Communications
5641 papers in training set
Top 30%
4.7%
50% of probability mass above
7
Journal of Neural Engineering
221 papers in training set
Top 0.8%
4.2%
8
Scientific Reports
3612 papers in training set
Top 31%
3.3%
9
Cerebral Cortex Communications
36 papers in training set
Top 0.1%
3.3%
10
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 18%
3.1%
11
Frontiers in Neuroscience
256 papers in training set
Top 2%
3.1%
12
eneuro
439 papers in training set
Top 3%
2.6%
13
Communications Biology
993 papers in training set
Top 9%
2.4%
14
NeuroImage
903 papers in training set
Top 4%
2.4%
15
Cell Reports
1498 papers in training set
Top 16%
2.3%
16
Journal of Neurophysiology
302 papers in training set
Top 2%
2.3%
17
Nature Human Behaviour
95 papers in training set
Top 1%
1.7%
18
Neuroscience
97 papers in training set
Top 1%
1.5%
19
Brain Structure and Function
93 papers in training set
Top 0.8%
1.5%
20
Imaging Neuroscience
282 papers in training set
Top 3%
1.3%
21
Brain
168 papers in training set
Top 3%
1.1%
22
Cell
431 papers in training set
Top 10%
0.9%
23
Nature Neuroscience
252 papers in training set
Top 5%
0.8%
24
Hearing Research
54 papers in training set
Top 0.4%
0.8%
25
Science Advances
1243 papers in training set
Top 34%
0.6%
26
Current Biology
665 papers in training set
Top 11%
0.6%