Integrating cellular graph embeddings with tumor morphological features to predict in-silico spatial transcriptomics from H&E images
Liu, K.; Prabhakar, V.
Show abstract
Spatial transcriptomics allows precise RNA abundance measurement at high spatial resolution, linking cellular morphology with gene expression. We present a novel deep learning algorithm predicting local gene expression from histopathology images. Our approach employs a graph isomorphism neural network capturing cell-to-cell interactions in the tumor microenvironment and a Vision Transformer (CTransPath) for obtaining the tumor morphological features. Using a dataset of 30,612 spatially resolved gene expression profiles matched with histopathology images from 23 breast cancer patients, we identify 250 genes, including established breast cancer biomarkers, at a 100 {micro}m resolution. Additionally, we co-train our algorithm on spatial spot-level transcriptomics from 10x Visium breast cancer data along with another variant of our algorithm on TCGA-BRCA bulk RNA Seq. data, yielding mutual benefits and enhancing predictive accuracy on both these datasets. This work enables image-based screening for molecular biomarkers with spatial variation, promising breakthroughs in cancer research and diagnostics.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- MOH: a novel multilayer multi-omics heterogeneous graph for single-cell clustering 96%
- pathCLIP: Detection of Genes and Gene Relations from Biological Pathway Figures through Image-Text Contrastive Learning 94%
- GREMI: an Explainable Multi-omics Integration Framework for Enhanced Disease Prediction and Module Identification 94%
Similar papers in this journal
- Spatial Transcriptomics Inferred from Pathology Whole-Slide Images Links Tumor Heterogeneity to Survival in Breast and Lung Cancer 96%
- DeepInsight-3D for precision oncology: an improved anti-cancer drug response prediction from high-dimensional multi-omics data with convolutional neural networks 95%
- Aggregation of Cohorts for Histopathological Diagnosis with Deep Morphological Analysis 94%
Similar papers in this journal
- An Integrative Multi-Omics Random Forest Framework for Robust Biomarker Discovery 94%
- Imputing missing RNA-seq data from DNA methylation by using transfer learning based-deep neural network 94%
- TuBA: Tunable Biclustering Algorithm Reveals Clinically Relevant Tumor Transcriptional Profiles in Breast Cancer 93%
Similar papers in this journal
- Predicting Spatially Resolved Gene Expression via Tissue Morphology using Adaptive Spatial GNNs 97%
- Graspot: A graph attention network for spatial transcriptomics data integration with optimal transport 95%
- Deep Learning Approach to Identifying Breast Cancer Subtypes Using High-Dimensional Genomic Data 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.