Counterfactual MRI Generation with Denoising Diffusion Models for Interpretable Alzheimer's Disease Effect Detection
Dhinagar, N. J.; Thomopoulos, S. I.; Laltoo, E.; Thompson, P. M.
Show abstract
Generative AI models have recently achieved mainstream attention with the advent of powerful approaches such as stable diffusion, DALL-E and MidJourney. The underlying breakthrough generative mechanism of denoising diffusion modeling can generate high quality synthetic images and can learn the underlying distribution of complex, high-dimensional data. Recent research has begun to extend these models to medical and specifically neuroimaging data. Typical neuroimaging tasks such as diagnostic classification and predictive modeling often rely on deep learning approaches based on convolutional neural networks (CNNs) and vision transformers (ViTs), with additional steps to help in interpreting the results. In our paper, we train conditional latent diffusion models (LDM) and denoising diffusion probabilistic models (DDPM) to provide insight into Alzheimers disease (AD) effects on the brains anatomy at the individual level. We first created diffusion models that could generate synthetic MRIs, by training them on real 3D T1-weighted MRI scans, and conditioning the generative process on the clinical diagnosis as a context variable. We conducted experiments to overcome limitations in training dataset size, compute time and memory resources, testing different model sizes, effects of pretraining, training duration, and latent diffusion models. We tested the sampling quality of the disease-conditioned diffusion using metrics to assess realism and diversity of the generated synthetic MRIs. We also evaluated the ability of diffusion models to conditionally sample MRI brains using a 3D CNN-based disease classifier relative to real MRIs. In our experiments, the diffusion models generated synthetic data that helped to train an AD classifier (using only 500 real training scans) -and boosted its performance by over 3% when tested on real MRI scans. Further, we used implicit classifier-free guidance to alter the conditioning of an encoded individual scan to its counterfactual (representing a healthy subject of the same age and sex) while preserving subject-specific image details. From this counterfactual image (where the same person appears healthy), a personalized disease map was generated to identify possible disease effects on the brain. Our approach efficiently generates realistic and diverse synthetic data, and may create interpretable AI-based maps for neuroscience research and clinical diagnostic applications.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- OpenMAP-T1: A Rapid Deep Learning Approach to Parcellate 280 Anatomical Regions to Cover the Whole Brain 96%
- WMH-DualTasker: A weakly-supervised deep learning model for automated white matter hyperintensities segmentation and visual rating prediction 96%
- Anatomy-guided, modality-agnostic segmentation of neuroimaging abnormalities 96%
Similar papers in this journal
- Comparison of domain adaptation techniques for white matter hyperintensity segmentation in brain MR images 95%
- Triplanar ensemble U-Net model for white matter hyperintensities segmentation on MR images 95%
- MISPEL: A supervised deep learning harmonizationmethod for multi-scanner neuroimaging data 95%
Similar papers in this journal
- Training Data Distribution Significantly Impacts the Estimation of Tissue Microstructure with Machine Learning 95%
- Accelerated multi-shell diffusion MRI with Gaussian process estimated reconstruction of multi-band imaging 95%
- SC-GAN: 3D self-attention conditional GAN with spectral normalization for multi-modal neuroimaging synthesis 95%
Similar papers in this journal
- Freewater EstimatoR using iNtErpolated iniTialization (FERNET): Toward Accurate Estimation of Free Water in Peritumoral Region Using Single-Shell Diffusion MRI Data 94%
- Personalized models of Disorders of Consciousness revealcomplementary roles of connectivity and local parameters in diagnosis and prognosis 92%
- pyKNEEr: An image analysis workflow for open and reproducible research on femoral knee cartilage 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.