PolyRNN: A time-resolved model of polyphonic musical expectations aligned with human brain responses
Robert, P.; Van Cang, M. P.; Mercier, M.; Trebuchon, A.; Bartolomei, F.; Arnal, L. H.; Morillon, B.; Doelling, K.
Show abstract
Musical expectations shape how we perceive and process music, yet current computational models are limited to monophonic or simplified stimuli. The study of the neural processes underlying musical expectations in real-world music therefore requires significant advances in our statistical modeling of these stimuli. We present PolyRNN, a recurrent neural network designed to model expectations in naturalistic, polyphonic music. We recorded neurophysiological activity non invasively (MEG) and within the human brain (intracranial EEG) while participants listened to naturally expressive piano recordings. The musical expectations estimated by the model are encoded in evoked P2- and P3-like components in auditory regions. Comparing PolyRNN to a state-of-the-art generative music model, we show that piano roll representations are best suited to represent expectations in polyphonic contexts. Overall, our approach provides a new way to capture the musical expectations emerging from natural music listening, and enables the study of predictive processes in more ecologically valid settings.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Online speech synthesis using a chronically implanted brain-computer interface in an individual with ALS 96%
- Audio-visual combination of syllables involves time-sensitive dynamics following from fusion failure 95%
- Sound perception in realistic surgery scenarios: Towards EEG-based auditory work strain measures for medical personnel. 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.