Trustworthy in silico labeling via semantic visual interpretability of image-to-image translation
Ben Nedava, L.; Miller, G.; Elmalam, N.; Viana, M. P.; Chen, J.; Gaudreault, N.; Rafelski, S. M.; Zaritsky, A.
Show abstract
Cross-modality image translation promises to provide multiple layers of biological information from a single image input, yet its practical application is stalled by a lack of interpretability and the inability to account for model imperfections. In silico labeling, the inference of organelle localization from label-free images, is a primary example where this black-box nature limits adoption. We present Mask Interpreter, a generalized method for semantic visual interpretability of image-to-image translation models. By uncovering organelle-specific "explanation signatures", Mask Interpreter validates that models rely on authentic biological structures rather than spurious artifacts. Beyond biological validation, it outperforms traditional explainable AI (xAI) approaches, identifies batch effects and localizes prediction errors when ground-truth fluorescence is unavailable. Semantic confidence modeling further provides fine-grained reliability assessment at single-cell resolution, enabling the automated exclusion of artifacts from downstream analyses. By bridging the gap between computational inference and meaningful biological features, Mask Interpreter transforms in silico labeling into a reliable tool for scientific discovery across diverse biomedical imaging modalities.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- A deep learning framework for nucleus segmentation using image style transfer 94%
- Learning multi-cellular representations of single-cell transcriptomics data enables characterization of patient-level disease states 93%
- Accurate single-molecule spot detection for image-based spatial transcriptomics with weakly supervised deep learning 93%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.