Self-supervised learning enables unbiased patient characterization from multiplexed microscopy images
Atarsaikhan, G.; Mogollon, I.; Valimaki, K.; iCAN, ; Mirtti, T.; Pellinen, T.; Paavolainen, L.
Show abstract
Multiplexed immunofluorescence microscopy offers detailed insights into the spatial architecture of cancer tissue. However, classical single-cell analysis approaches are limited by segmentation accuracy, reliance on predefined features, and the inability to capture spatial interrelationships among cells. We developed a hierarchical self-supervised deep learning framework that learns spatial protein marker patterns from multiplexed microscopy images by encoding the tissue at both local (cellular) and global (tissue architecture) levels. Applied to lung, prostate, and renal cancer tissue microarray cohorts, our method stratified patients into prognostically distinct groups with significantly different survival outcomes. These groupings were consistent with prior expert-driven single-cell analyses, demonstrating the validity of our approach. Furthermore, attention maps extracted from these models highlighted biologically relevant tissue regions associated with specific marker patterns. Overall, our framework effectively profiles complex multiplexed microscopy images and offers a scalable, interpretable tool for improved biomarker discovery, with potential to support more informed cancer treatment decisions.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- STAIG: Spatial Transcriptomics Analysis via Image-Aided Graph Contrastive Learning for Domain Exploration and Alignment-Free Integration 96%
- Teacher-student collaborated multiple instance learning for pan-cancer PDL1 expression prediction from histopathology slides 96%
- Learning tissue representation by identification of persistent local patterns in spatial omics data 96%
Similar papers in this journal
- Aggregation of Cohorts for Histopathological Diagnosis with Deep Morphological Analysis 97%
- Spatial Transcriptomics Inferred from Pathology Whole-Slide Images Links Tumor Heterogeneity to Survival in Breast and Lung Cancer 96%
- Construction and optimization of multi-platform precision pathways for precision medicine 96%
Similar papers in this journal
- StereoMM: A Graph Fusion Model for Integrating Spatial Transcriptomic Data and Pathological Images 96%
- SHEST: Single-cell-level artificial intelligence from haematoxylin and eosin morphology for cell type prediction and spatial transcriptomics reconstruction 96%
- Computationally scalable regression modeling for ultrahigh-dimensional omics data with ParProx 95%
Similar papers in this journal
Similar papers in this journal
- Obtaining Spatially Resolved Tumor Purity Maps Using Deep Multiple Instance Learning In A Pan-cancer Study 96%
- Bi-level Graph Learning Unveils Prognosis-Relevant Tumor Microenvironment Patterns in Breast Multiplexed Digital Pathology 95%
- S3-CIMA: Supervised spatial single-cell image analysis for the identification of disease-associated cell type compositions in tissue 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.