When Meaning Matters Most: Rethinking Cloze Probability in N400 Research
Arkhipova, Y.; Lopopolo, A.; Vasishth, S.; Rabovsky, M.
Show abstract
The N400 component of ERPs is modulated by how predictable a word is, but predictability is usually quantified with lexical cloze--the probability that readers supply that exact word in offline sentence completion tasks. This form-based metric is at odds with decades of evidence that the N400 is primarily sensitive to meaning. Here, we asked whether a measure of semantic feature predictability can better account for N400 amplitude modulation. We reanalysed two independent EEG datasets (N = 26 and N = 334), computing lexical and semantic cloze for each critical word. Across both datasets, semantic cloze emerged as a better predictor of the N400 data than lexical cloze. Using the same materials, we then compared semantic and lexical cloze with probabilities from four large language models (GPT-2, GPT-2.7b, RoBERTa, ALBERT). None of the LLM-derived predictors outperformed semantic cloze. Our findings support the view that the N400 primarily reflects semantic--not exact-word--processing. Methodologically, we argue that replacing lexical cloze with semantic cloze can substantially increase the explanatory power of N400 studies, and caution against substituting human norms with raw LLM probabilities.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Prior context and individual alpha frequency (IAF) influence predictive processing during language comprehension 98%
- The P600 during sentence reading predicts behavioral and neural markers of recognition memory 97%
- Error-based implicit learning in language: the effect of sentence context and constraint in a repetition paradigm 97%
Similar papers in this journal
- Parafoveal and foveal N400 effects in natural sentence reading: A timeline of semantic processing from fixation-related potentials 97%
- Parafoveal words can modulate sentence meaning: Electrophysiological evidence from an RSVP-with-flanker task 97%
- The P600 and P3 ERP components are linked to the task-evoked pupillary response as a correlate of norepinephrine activity 96%
Similar papers in this journal
- Salience-weighted agreement feature hierarchy modulates language comprehension. 96%
- Dissociating activation and integration of discourse referents: evidence from ERPs and oscillations 96%
- The Late Positive Event-Related Potential Component is Time-Locked to the Decision in Recognition Memory Tasks 95%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.