Effective Representation Learning via The Integrated Self-Supervised Pre-training models of StyleGAN2-ADA and DINO for Colonoscopy Images
Kim, J.-Y.; Tangriberganov, G.; Jung, W.; Kim, D. S.; Koo, H. S.; Lee, S.; Kim, S. M.
Show abstract
In order to reach better performance in visual representation learning from image or video dataset, huge amount of annotated data are on demand. However, collecting and annotating large-scale datasets are costly and time-consuming tasks. Especially, in a domain like medical, it is hard to access patient images because of the privacy concerns and also not knowing what exactly to annotate without expert effort. One of the solutions to obviate the hassle is to use Self-Supervised learning methods (SSL) and Generative Adversarial Networks (GANs) together. SSL and GANs are quickly advancing fields. GANs have unique capability to create unlabeled data sources containing photo-realistic images while SSL methods are able to learn general image and video features from large-scale data without using any human-annotated labels. In this work, we explore leveraging the power of recently introduced StyleGAN2-ada and Self-Supervised Pre-Training of Dino together for the pretext task. Our underlying insight is also that leveraging the current approaches with Transfer Learning (TF) together brings benefit on doing pretext task in medical domain. By the strategy of unifying these two approaches, we propose the integrated version and use it derive representation learning on polyp dataset.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- SN-FPN: Self-attention Nested Feature Pyramid Network for Digital Pathology Image Segmentation 95%
- Cell segmentation without annotation by unsupervised domain adaptation based on cooperative self-learning 94%
- The tempest in a cubic millimeter: Image-based refinements necessitate the reconstruction of 3D microvasculature from a large series of damaged alternately-stained histological sections 93%
Similar papers in this journal
- Complementary Performances of Convolutional and Capsule Neural Networks on Classifying Microfluidic Images of Dividing Yeast Cells 95%
- Deep learning models for COVID-19 chest x-ray classification: Preventing shortcut learning using feature disentanglement 95%
- Small hand-designed convolutional neural networks outperform transfer learning in automated cell shape detection in confluent tissues 94%
Similar papers in this journal
Similar papers in this journal
- A novel interpretable deep transfer learning combining diverse learnable parameters for improved T2D prediction based on single-cell gene regulatory networks 95%
- WormSwin: Instance segmentation of C. elegans using vision transformer 94%
- An Assistive Computer Vision Tool to Automatically Detect Changes in Fish Behavior In Response to Ambient Odor 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.