Conformalized Multiview Learning
Roy, S.; Sarkar, S.; Banerjee, C.; Paul, E.; Basak, P.; Mallick, H.
Show abstract
SO_SCPLOWUMMARYC_SCPLOWThere is an overwhelmingly large body of literature and numerous algorithms already available on "multimodal AI", based on different modeling and fusion paradigms. As multimodal AI becomes fully integrated into healthcare applications, the ability to say "Im not sure" or "I dont know" when uncertain is a necessary capability for safe clinical deployment, requiring the augmentation of current multimodal AI techniques. Our goal in this work is not to add yet another method to the growing toolbox of multimodal AI, but rather to (i) clarify how existing supervised multimodal AI methods can be understood through the lens of uncertainty quantification, and (ii) develop a unified framework that provides valid and interpretable uncertainty estimates for multimodal AI practitioners. We introduce Coracle, a conformalized framework for multimodal AI that seamlessly adapts to early, late, and intermediate fusion. Coracle provides theoretical marginal confidence guarantees and achieves valid finite-sample coverage without relying on distributional assumptions. Through extensive simulations and analyses of diverse biomedical multiview datasets, we demonstrate that Coracle consistently outperforms existing non-conformalized methods in both uncertainty estimation and calibration. By equipping published multiview models with valid, interpretable confidence measures, Coracle advances the development of trustworthy, uncertainty-aware statistical tools for biomedical decision support. Coracle is publicly available as an open-source R package at https://github.com/himelmallick/Coracle.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Single-Cell Multi-Modal GAN (scMMGAN) reveals spatial patterns in single-cell data from triple negative breast cancer 95%
- Hierarchical confounder discovery in the experiment-machine learning cycle 94%
- Generating realistic neurophysiological time series with denoising diffusion probabilistic models 93%
Similar papers in this journal
- Evaluation of out-of-distribution detection methods for data shifts in single-cell transcriptomics 95%
- Synthetic observations from deep generative models and binary omics data with limited sample size 94%
- Novel multi-omics deconfounding variational autoencoders can obtain meaningful disease subtyping 94%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.