Restoring brain-to-text communication in a person with dysarthria from pontine stroke using an intracortical brain-computer interface
Nason-Tomaszewski, S. R.; Deevi, P. I.; Rabbani, Q.; Jacques, B. G.; Pritchard, A. L.; Wimalasena, L. N.; Richards, B. A.; Karpowicz, B. M.; Bechefsky, P. H.; Card, N. S.; Deo, D. R.; Choi, E. Y.; Hochberg, L. R.; Stavisky, S. D.; Brandman, D. M.; AuYong, N.; Pandarinath, C.
Show abstract
Restoring communication for people with dysarthria secondary to pontine stroke remains a critical challenge. Intracortical brain-computer interfaces (iBCIs) have demonstrated great potential for speech restoration in people with amyotrophic lateral sclerosis (ALS), with 1-24% word error rates (WERs) on a 125,000-word vocabulary. In pontine stroke, electrocorticography (ECoG) BCIs achieved 25.5% WERs with a smaller 1,024-word vocabulary. Whether intracortical BCI performance improvements extend to people with pontine stroke-induced dysarthria remains unclear. Here, we show that neural activity from a single 64-channel microelectrode array in orofacial motor cortex can predict attempted speech in a person with pontine stroke more accurately than prior ECoG BCI work and comparably to prior iBCI work. We trained a neural network decoder to predict phoneme probabilities from spiking rates and spike-band power as BrainGate2 participant T16 mimed (mouthed without vocalization) sentences from a large vocabulary. A series of language models converted these probabilities into word sequences. This decoding architecture has remained stable more than two years post-implantation, achieving a median 19.6% WER with a 125,000-word vocabulary and a median 10.0% WER with a 1,024-word vocabulary (a 60.8% reduction over prior ECoG studies). This framework also generalized beyond cue repetition, enabling T16 to communicate spontaneously via the iBCI in a question-and-answer setting with a 35.2% WER. These results demonstrate that brain-to-text decoding from a small patch of cortex can outperform ECoG-based systems in individuals with pontine stroke and is comparable to early speech iBCIs in individuals with ALS.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Ultra-fast Prediction of Somatic Structural Variations by Reduced Read Mapping via Pan-Genome k-mer Sets 91%
- Neuroimaging-AI Endophenotypes of Brain Diseases in the General Population: Towards a Dimensional System of Vulnerability 91%
- In vivo fluorescence imaging with a flat, lensless microscope 90%
Similar papers in this journal
Similar papers in this journal
- Consistent cross-modal identification of cortical neurons with coupled autoencoders 93%
- Integrating spatial transcriptomics data across different conditions, technologies, and developmental stages 92%
- Adversarial domain translation networks for fast and accurate integration of large-scale atlas-level single-cell datasets 91%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.