Semantic distance differently modulates FPVS-EEG responses to words and pictures

The organization of semantic knowledge within the brain has long been studied through various theoretical frameworks and is still a matter of debate. Many studies that have helped advancing our knowledge about this topic have approached it in the context of its deterioration, notably in patients with semantic dementia. In healthy subjects, the question whether and how semantic distance between concepts represented by picture or word stimuli influences brain responses remains understudied. In this study with 24 healthy subjects, we used electroencephalography (EEG) recordings coupled with a fast periodic visual stimulation (FPVS) approach, for the first time, to assess the semantic distance effect with different stimulus modalities. Picture or word stimuli from a reference category (birds) appeared every fourth item among a 4-Hz stream of either man-made objects (forming the high distance [HD] condition) or other animals (low distance [LD] condition). Within a few minutes of recording, EEG responses were observed at the pre-determined frequency of the reference category presentation (at 1 Hz), suggesting its exemplars were activated at least sufficiently to be automatically discriminated from different superordinate (HD) and basic (LD) categories, for both pictures and words. Pictures and words elicited a different pattern of response to semantic distance, with larger amplitudes for HD than LD conditions for pictures but a reversed pattern of somewhat greater amplitudes for LD than HD conditions for words. Our findings support a similarity-based structure of semantic representations and provide evidence for a differential mapping between semantic and picture/word surface representations.