Modality Fusion of MRI and Clinical Data for Glioma Tumour Grading
Kheirbakhsh, R.; Mathur, P.; Lawlor, A.
Show abstract
Multimodal machine learning leverages complementary information from diverse data sources and has shown strong promise in medical imaging, where multimodal data is critical for clinical decision making. In glioma grading, integrating MRI modalities with clinical data can improve diagnostic accuracy, yet systematic comparisons of fusion strategies remain limited. This study evaluates early, intermediate, and late fusion approaches, addressing the question: How does the inclusion of clinical data alongside MRI modalities influence grading performance? To assess modality contributions, we design adaptable fusion layers and employ interpretability techniques, including attention-based analysis. Our results show that incorporating clinical data consistently outperforms unimodal and MRI-only baselines, with intermediate fusion yielding the most reliable gains. Beyond accuracy, the framework reveals how MRI and clinical features jointly shape predictions, underscoring the importance of both fusion design and interpretability for clinical adoption.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- STAMP: Simultaneous Training and Model Pruning for Low Data Regimes in Medical Image Segmentation 95%
- Comparison of domain adaptation techniques for white matter hyperintensity segmentation in brain MR images 95%
- Triplanar ensemble U-Net model for white matter hyperintensities segmentation on MR images 94%
Similar papers in this journal
Similar papers in this journal
- Dual Adversarial Deconfounding Autoencoder for joint batch-effects removal from multi-center and multi-scanner radiomics data 95%
- Probabilistic Brain MR Image Transformation Using Generative Models 94%
- Improving Rectal Tumor Segmentation with Anomaly Fusion Derived from Anatomical Inpainting: A Multicenter Study 94%
Similar papers in this journal
- Deep Multimodal Graph-Based Network for Survival Prediction from Highly Multiplexed Images and Patient Variables 95%
- BenchXAI: Comprehensive Benchmarking of Post-hoc Explainable AI Methods on Multi-Modal Biomedical Data 94%
- Application of a convolutional neural network to the quality control of MRI defacing 93%
Similar papers in this journal
- Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs 95%
- Machine learning assisted DSC-MRI radiomics as a tool for glioma classification by grade and mutation status 93%
- Addressing Label Noise for Electronic Health Records: Insights from Computer Vision for Tabular Data 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.