SXTractor: A Self-Supervised Feature Extractor of Soft X-Ray Images That Enables Few-Shot Tomogram Segmentation
Chueh, S.; Brink, M. C.; Simpson, J. C.; Kapishnikov, S.
Show abstract
Soft X-ray tomography (SXT) is a powerful, non-invasive bio-imaging technique that enables visualization of cellular structures in near-native states. Despite its potential, the development of dedicated image analysis tools -- particularly deep-learning-based models -- has been limited, largely due to the limited accessibility of soft X-ray microscopes and the scarcity of labeled SXT data. To address this deficit, in this work, we present SXTractor, a self-supervised SXT feature extractor based on the DINO framework. SXTractor can be fine-tuned with minimal labeled data and effectively adapted to various downstream tasks. We demonstrate its utility on few-shot tomogram segmentation, where it significantly outperforms the model when trained from scratch. Furthermore, it achieves few-shot segmentation performance comparable to that of the Segment Anything Model (SAM), despite SAM being a segmentation-specific model pretrained on millions of labeled images with a significantly larger model size. Most importantly, SXTractor enables a diverse range of downstream applications of deep learning to SXT, thus offering a practical and scalable solution for SXT image analysis in data-constrained settings.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- A Deep Learning approach for time-consistent cell cycle phase prediction from microscopy data 97%
- RETINA: Reconstruction-based Pre-Trained Enhanced TransUNet for Electron Microscopy Segmentation on the CEM500K Dataset 96%
- Cell-TRACTR: A transformer-based model for end-to-end segmentation and tracking of cells 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.