Back

Differential neural encoding of sound under visual attention is shaped by audiovisual precision and unimodal uncertainty priors

Cervantes Constantino, F.; Sanchez-Costa, T.; Cipriani, G. A.; Carboni, A.

2020-08-01 neuroscience
10.1101/2020.07.30.229948 bioRxiv
Show abstract

Selective attentional biases arising from one sensory modality may manifest in another. The effects of visuospatial attention, often considered a foundation for visual object perception, are unclear in the auditory domain during audiovisual (AV) scene processing. This study investigates temporal and spatial factors that facilitate such cross-modal bias transfer at the neural level. Auditory encoding of random tone pips in AV scenes was investigated via a temporal response function model (TRF) of the participants electroencephalogram (N=30). The spatially uninformative pips were associated with spatially distributed visual contrast reversals ( flips) through asynchronous, probabilistic AV temporal onset distributions. Participants deployed visuospatial selection on these AV stimuli to perform a task. A late (~300 ms) cross-modal transfer of the unimodal attentional bias was found on the neural representation of pips. Transfer depended on the selected visual input being (i) presented during or shortly after a related sound in a relatively limited temporal window (<165 ms); and (ii) positioned across limited (1:4) visual foreground to background ratios. In addition, the magnitude of attentional enhancement was proportional to the proximity of flips to the foreground area. The results indicate that ongoing neural representations of sounds can incorporate relevant visuospatial attributes for auditory stream segregation.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.