Individual variations in McGurk illusion susceptibility reflect different integration-segregation strategies of audiovisual speech perception
Dong, C.; Wang, Z.; Li, R.; Wang, S.
Show abstract
The McGurk illusion is a widely used indicator of audiovisual speech integration. In this illusion, incongruent visual articulations biases the auditory speech percepts, resulting in illusory percepts that different from both auditory and visual inputs. Despite its widespread use, its validity for measuring audiovisual integration has been questioned due to substantial individual variations. Classical forced fusion theories propose that variations in McGurk illusion susceptibility reflect differences in multisensory integration ability, whereas Bayesian causal inference (BCI) theory proposes that these variations reflect different audiovisual integration-segregation strategies used according to unisensory accuracy and inferred casual structures of the auditory and visual signals. To test these two proposals, we investigated the relationships between variations in McGurk illusion susceptibility and unisensory accuracy across testing time (Experiment 1, N =161), task type (Experiment 2, N = 88), and stimuli (Experiment 3, N = 37). We found stable negative correlations between McGurk illusion susceptibility and unisensory accuracy both at the group level and single participant level. Participants with weak illusion susceptibility had higher unisensory accuracy than participants with strong illusion susceptibility. Conversely, participants with strong illusion susceptibility were more likely to incorrectly categorize the auditory and visual stimuli as illusory percepts. Moreover, participants with similar unisensory accuracy showed similar McGurk illusion susceptibility. Consistent with the BCI theory, our results indicate that individual variations in McGurk illusion susceptibility reflect different integration-segregation strategies used by participants due to variations in unisensory accuracy. Failing to perceive an illusion does not indicate a failure to integrate audiovisual signals; instead, it indicates a successful segregation of incongruent signals. These findings suggest that caution is necessary when generalizing variations in McGurk illusion susceptibility to differences in audiovisual integration ability.
Matching journals
The top 10 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Multisensory interactions on auditory and somatosensory information in expert pianists 96%
- Visualizing sounds: training-induced plasticity with a visual-to-auditory conversion device 95%
- Auditory-cognitive determinants of speech-in-noise perception: structural equation modelling of a large sample 94%
Similar papers in this journal
- Corollary Discharge versus Efference Copy: Distinct Neural Signals in Speech Preparation Differentially Modulate Auditory Responses 95%
- Dissociated amplitude and phase effects of alpha oscillation in a nested structure of rhythm- and sequence-based temporal expectation 93%
- Audiovisual Integration in the Human Brain: A Coordinate-based Meta-analysis 93%
Similar papers in this journal
- Individual Differences in Cognition and Perception Predict Neural Processing of Speech in Noise for Audiometrically Normal Listeners. 94%
- Loudness and sound category: Their distinct roles in shaping perceptual and physiological responses to soundscapes 94%
- Category-based attention facilitates memory search 93%
Similar papers in this journal
- Both stimulus-specific and configurational features of multiple visual stimuli shape the spatial ventriloquism effect 94%
- Perceived multisensory common cause relations shape the ventriloquism effect but only marginally the trial-wise aftereffect 94%
- Perceptual learning of random acoustic patterns: Impact of temporal regularity and attention 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.