Back

Speech recognition from MEG data using covariance filters

Verkhlyutov, V. M.; Vvedensky, V. L.; Gurtovoy, K. G.; Burlakov, E. O.; Martynova, O. V.

2023-06-26 neuroscience
10.1101/2023.06.22.546174 bioRxiv
Show abstract

Speech recognition from EEG and MEG data is the first step in the development of BCI and AI systems for further use in the decoding of inner speech. Great achievements in this direction have been made with the use of ECoG and stereo-EEG. At the same time, there are few works on this topic on the analysis of data obtained by nonin-vasive methods of brain activity registration. Our approach is based on the evaluation of connections in the sensor space with the extraction of the MEG connectivity pattern specific to a given segment of speech. We tested our method on 7 subjects. In all cases, our processing pipeline was sufficiently reliable and worked either without recognition errors or with few errors. After "training" the algorithm is able to recognize a fragment of spoken speech in a single presentation. For recognition, we used MEG recording segments of 50-1200 ms from the beginning of the word. A segment of at least 600 ms was required for high-quality recognition. Intervals longer than 1200 ms degraded the quality of recognition. Band-pass filtering of MEG showed that the quality of recognition is higher when using the gamma frequency range compared to the low-frequency range of the analyzed signal.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.