3 ms·
So instead of image annotation, self-supervised learning performs image manipulation to train a model. Then what? Is this network then piped into the original
by trash3 7y ago
So instead of image annotation, self-supervised learning performs image manipulation to train a model. Then what? Is this network then piped into the original task at hand which would have required human annotations or is it simply for these made up tasks?
- Voloskaya 7y agoYou then add a few additional layers on top, and you train those new layers in a classic supervised way. But because a lot has already been learned you need way less labels.
- contravariant 7y agoOptimistically if a self-supervised algorithm is capable of understanding a concept then it shouldn't need all that many examples to make it useful. Ideally you could just show it what cats look like (with just a couple of examples) and ask it to find more of them.
- ivalm 7y agoTwo main things you can do: 1) Transfer learning -- start with self supervised model and either fine tune parameters or freeze parameters + add another layer to train your task (with way fewer params/necessary labels since you already learned about the input distribution) 2) Nearest neighbor/clustering -- no need to label all classes, simply fetch similar examples (eg find semantically similar sentences in a corpus).