Unsupervised temporal consistency improvement for microscopy video segmentation with Siamese networks
Shabanov, A.; Schichler, D.; Pape, C.; Cuylen-Haering, S.; Kreshuk, A.
Show abstract
We introduce a simple mechanism by which a CNN trained to perform semantic segmentation of individual images can be re-trained - with no additional annotations - to improve its performance for segmentation of videos. We put the segmentation CNN in a Siamese setup with shared weights and train both for segmentation accuracy on annotated images and for segmentation similarity on unlabelled consecutive video frames. Our main application is live microscopy imaging of membrane-less organelles where the fluorescent groundtruth for virtual staining can only be acquired for individual frames. The method is directly applicable to other microscopy modalities, as we demonstrate by experiments on the Cell Segmentation Benchmark. Our code is available at https://github.com/kreshuklab/learning-temporal-consistency.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- The tempest in a cubic millimeter: Image-based refinements necessitate the reconstruction of 3D microvasculature from a large series of damaged alternately-stained histological sections 94%
- Cell segmentation without annotation by unsupervised domain adaptation based on cooperative self-learning 94%
- SN-FPN: Self-attention Nested Feature Pyramid Network for Digital Pathology Image Segmentation 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.