Back

Multimodal normative modeling in Alzheimer Disease with introspective variational autoencoders

Kumar, S.; Qiu, P.; Yang, B.; Bani, A.; Payne, P.; Sotiras, A.

2024-12-17 neuroscience
10.1101/2024.12.12.628273 bioRxiv
Show abstract

Normative models in neuroimaging learn patterns of healthy brain distributions to identify deviations in disease subjects, such as those with Alzheimers Disease (AD). This study addresses two key limitations of variational autoencoder (VAE)-based normative models: (1) VAEs often struggle to accurately model healthy control distributions, resulting in high reconstruction errors and false positives, and (2) traditional multimodal aggregation methods, like Product-of-Experts (PoE) and Mixture-of-Experts (MoE), can produce uninformative latent representations. To overcome these challenges, we developed a multimodal introspective VAE that enhances normative modeling by achieving more precise representations of healthy anatomy in both the latent space and reconstructions. Additionally, we implemented a Mixture-of-Product-of-Experts (MOPOE) approach, leveraging the strengths of PoE and MoE to efficiently aggregate multimodal information and improve abnormality detection in the latent space. Using multimodal neuroimaging biomarkers from the Alzheimers Disease Neuroimaging Initiative (ADNI) dataset, our proposed multimodal introspective VAE demonstrated superior reconstruction of healthy controls and outperformed baseline methods in detecting outliers. Deviations calculated in the aggregated latent space effectively integrated complementary information from multiple modalities, leading to higher likelihood ratios. The model exhibited strong performance in Out-of-Distribution (OOD) detection, achieving clear separation between control and disease cohorts. Additionally, Z-score deviations in specific latent dimensions were mapped to feature-space abnormalities, enabling interpretable identification of brain regions associated with AD pathology.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.