Back

Concept2Brain: An AI model for predicting subject-level neurophysiological responses to text and pictures

Santos-Mayo, A.; Gilbert, F.; Mirifar, A.; Tebbe, A.-L.; Fang, R.; Ding, M.; Keil, A.

2025-08-05 neuroscience
10.1101/2025.08.04.668476 bioRxiv
Show abstract

The current growth of artificial intelligence (AI) tools provides an unprecedented opportunity to extract deeper insights from neurophysiological data while also enabling the reproduction and prediction of brain responses to a wide range of events and situations. Here, we introduce the Concept2Brain model, a deep network architecture designed to generate synthetic electrophysiological responses to semantic/emotional information conveyed through pictures or text. Leveraging AI solutions like CLIP from OpenAI, the model generates a representation of pictorial or language input and maps it into an electrophysiological latent space. We demonstrate that this openly available resource generates synthetic neural responses that closely resemble those observed in studies of naturalistic scene perception. The Concept2Brain model is provided as a web service tool for creating open and reproducible EEG datasets, allowing users to predict brain responses to any semantic concept or picture. Beyond its applied functionality, it also paves the way for AI-driven modeling of brain activity, offering new possibilities for studying how the brain represents the world.

Matching journals

The top 7 journals account for 50% of the predicted probability mass.

1
Scientific Reports
○ 3612 papers in training set
Top 3%
11.5%
Similar papers in this journal
2
Scientific Data
○ 209 papers in training set
Top 0.2%
11.5%
Similar papers in this journal
3
Nature Communications
○ 5641 papers in training set
Top 19%
9.4%
Similar papers in this journal
4
NeuroImage
○ 903 papers in training set
Top 2%
6.5%
Similar papers in this journal
5
Communications Biology
○ 993 papers in training set
Top 2%
5.0%
Similar papers in this journal
6
eLife
● 5828 papers in training set
Top 27%
4.7%
7
Imaging Neuroscience
● 282 papers in training set
Top 1%
4.2%
50% of probability mass above
8
iScience
○ 1154 papers in training set
Top 6%
3.4%
9
Journal of Neuroscience Methods
○ 122 papers in training set
Top 0.6%
3.1%
10
Patterns
○ 78 papers in training set
Top 0.6%
3.1%
11
Nature Human Behaviour
○ 95 papers in training set
Top 0.7%
3.1%
12
Nature Machine Intelligence
○ 70 papers in training set
Top 1%
2.6%
13
PLOS Computational Biology
● 1863 papers in training set
Top 11%
2.6%
14
Nature Computational Science
○ 55 papers in training set
Top 0.4%
2.3%
15
Frontiers in Neuroscience
○ 256 papers in training set
Top 3%
1.7%
16
Nature Neuroscience
○ 252 papers in training set
Top 4%
1.6%
17
Cell Reports
○ 1498 papers in training set
Top 21%
1.5%
18
Journal of Neural Engineering
○ 221 papers in training set
Top 2%
1.5%
19
Advanced Science
○ 286 papers in training set
Top 5%
1.5%
20
Frontiers in Psychiatry
○ 87 papers in training set
Top 2%
1.1%
21
Proceedings of the National Academy of Sciences
● 2444 papers in training set
Top 38%
1.0%
22
Neural Computation
● 39 papers in training set
Top 0.7%
1.0%
23
Science Advances
● 1243 papers in training set
Top 32%
0.8%
24
Nature Protocols
○ 33 papers in training set
Top 0.7%
0.6%
25
Frontiers in Computational Neuroscience
○ 60 papers in training set
Top 1%
0.6%
26
Nature Methods
○ 385 papers in training set
Top 7%
0.6%
27
Network Neuroscience
● 126 papers in training set
Top 2%
0.6%
28
PLOS ONE
● 5266 papers in training set
Top 63%
0.6%

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.