Yeah, authors have tried mixing the strategy you described(self-supervised learning) for semi-supervised tasks. Basic idea is to learn generic image representa

Yeah, authors have tried mixing the strategy you described(self-supervised learning) for semi-supervised tasks. Basic idea is to learn generic image representations without manual labeling and then finetune that on your small dataset. These are relevant articles I have wrote on it: https://amitness.com/2020/02/illustrated-self-supervised-learning/ https://amitness.com/2020/02/illustrated-self-supervised-lea... https://amitness.com/2020/03/illustrated-simclr/ https://amitness.com/2020/03/illustrated-simclr/