Neural Integration of Affective Prosodic and Semantic Cues in Non-literal Forms of Speech Understanding
Wittmann, A.; Ceravolo, L.; Mayr, A.; Grandjean, D.
Show abstract
Emotions in speech are conveyed through both semantics and prosody--voice melody, yet how listeners integrate these cues in the brain remains unclear. We investigated non-literal forms of speech, such as irony and sarcasm, where understanding beyond literal meaning relies on the dynamic interplay between affective prosodic and semantic cues, alongside theory of mind (ToM). We used functional magnetic resonance imaging while participants listened to short dialogues between two characters, which varied in prosody and semantics to convey either literal or non-literal meanings. Behaviorally, semantics and prosody interacted in shaping participants evaluations, although the data suggest a prosody dominance effect. Non-literal speech engaged the bilateral inferior frontal gyrus, temporal speech regions, and ToM areas, while integration-demanding tasks (e.g., irony, sarcasm, ToM) evoked stronger ToM-network activation than prosody or semantics tasks. Taken together, our data clarify the behavioral and neural underpinnings of the integration of prosody and semantics in non-literal speech and open new venues in this field.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- A common neural code for meaning in discourse production and comprehension 97%
- Stimulus-independent neural coding of event semantics: Evidence from cross-sentence fMRI decoding 97%
- Language beyond the language system: dorsal visuospatial pathways support processing of demonstratives and spatial language during naturalistic fast fMRI 96%
Similar papers in this journal
Similar papers in this journal
- Shared Neural Representations of Cognitive Conflict and Negative Affect in the Medial Frontal Cortex 97%
- Increased functional connectivity of the intraparietal sulcus underlies the attenuation of numerosity estimations for self-generated words 96%
- Decomposing Cognitive Processes in the mPFC During Self-Thinking 96%
Similar papers in this journal
- The role of the right language network and the multiple-demand network in verbal semantics: Insights from an Activation Likelihood Estimation Meta-analysis of 561 Functional Neuroimaging Studies 97%
- Semantic integration demands modulate large-scale network interactions in the brain 97%
- Mapping Contributions of the Anterior Temporal Semantic Hub to the Processing of Abstract and Concrete Verbs 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.