Back

Decoding the Unintelligible: Neural Speech Tracking in Low Signal-to-Noise Ratios

He, X.; Raghavan, V. S.; Mesgarani, N.

2024-10-12 neuroscience
10.1101/2024.10.10.616521 bioRxiv
Show abstract

Understanding speech in noisy environments is challenging for both human listeners and speech technologies, with significant implications for hearing aid design and communication systems. Auditory attention decoding (AAD) aims to decode the attended talker from neural signals to enhance their speech and improve perception. However, whether this decoding remains reliable under severely degraded listening conditions remains unclear. In this study, we investigated selective neural tracking of the attended speaker under adverse listening conditions. Using EEG recordings in a multi-talker speech perception task with varying SNR, participants task performance--quantified through a repeated-word detection task--was analyzed as a proxy for perceptual accuracy and attentional focus, while neural responses were used to decode the attended talker. Despite substantial degradation in task performance, we found that neural tracking of attended speech persists, suggesting that the brain retains sufficient information for decoding. These findings demonstrate that even in highly challenging conditions, AAD remains feasible, offering a potential avenue for improving speech perception in brain-informed audio technologies, such as hearing aids, that leverage AAD to enhance listening experiences in real-world noisy environments.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.