AREION: A Foundation Model for Atlas-Agnostic Representation Learning of Brain Connectome
Zhang, Z.; Li, H.; Zhang, Y.; You, G.; Wang, C.; Fan, Y.
Show abstract
Brain foundation models have shown promising advances in learning generalizable representations from functional magnetic resonance imaging (fMRI) data. However, existing models are typically tied to specific brain atlases and cannot be applied to fMRI data represented using different atlases without full retraining, thereby severely limiting their broader utility across neuroimaging studies. To address this bottleneck, we introduce AREION, atlas-agnostic representation learning of brain connectomes. AREION overcomes atlas dependency through two integrated innovations. First, a Brain Region Contextualizing technique maps brain regions and connectivity entries from diverse atlases into a unified representation space based on their spatial, functional, and morphological characteristics. Second, a Hierarchical Brain Transformer Encoder processes region-specific connectivity profiles as variable-length token sequences and jointly captures local functional structure and global brain functional organization, conditioned on brain regional context, without assuming a fixed number of regions. Together, these two techniques enable the learning of generalizable representations across brain atlases with different parcellation resolutions and connectivity dimensions. AREION is pretrained on a large-scale multi-atlas cohort of fMRI data via self-supervised modeling and evaluated across diverse downstream tasks. Extensive experiments show that it outperforms strong supervised baselines and fMRI foundation models while using substantially fewer parameters, demonstrating strong transferability to atlases unseen during pretraining, generalization to external datasets, and excellent interpretability at the brain regional level.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Self-Supervised Natural Image Reconstruction and Large-Scale Semantic Classification from Brain Activity 94%
- An empirical evaluation of functional alignment using inter-subject decoding 94%
- There is no single functional atlas even for a single individual: Parcellation of the human brain is state dependent 94%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.