Back

IST-editing: Infinite spatial transcriptomic editing in a generated gigapixel mouse pup

Wu, J.; Berg, I.; Koelzer, V. H.

2023-12-23 bioinformatics
10.1101/2023.12.23.573175 bioRxiv
Show abstract

Advanced spatial transcriptomics (ST) techniques provide comprehensive insights into complex living systems across multiple scales, while simultaneously posing challenges in bioimage analysis. The spatial co-profiling of biological tissues by gigapixel whole slide images (WSI) and gene expression arrays motivates the development of innovative and efficient algorithmic approaches. Using Generative Adversarial Nets (GAN), we introduce Infinite Spatial Transcriptomic editing (IST-editing) and establish gene expression-guided editing in a generated gigapixel mouse pup. Trained with patch-wise high-plex gene expression (input) and matched image data (output), IST-editing enables the synthesis of arbitrarily large bioimages at inference, e.g., with a 106496x53248 resolution. After feeding edited gene expressions to the trained network, we model cell-, tissue- and animal-level morphological transitions in the generated mouse pup. Lastly, we discuss and evaluate editing effects on interpretable morphological features. The generated WSIs of the mouse pup and code are publicly released and accessible via https://github.com/CTPLab/IST-editing.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.