3 ms·
To expand on this (complete correct) response, unsupervised training is often part of the training process for a zero-shot prediction task. For example it's pr
by nl 8y ago
To expand on this (complete correct) response, unsupervised training is often part of the training process for a zero-shot prediction task.
For example it's pretty common to use unsupervised learning to build embeddings for each target language, align the embeddings somehow (noting that you don't have labels, so you are using the multi-dimensional shapes within the embeddings to try to match them) and then finally test against labelled data (the zero-shot thing).
Zero shot, cross modal transfer is something humans do really well. You can read a description of a Platypus and then label it correctly even if you have never seen one before.
A seminal paper in this was Richard Socher's Zero-Shot Learning Through Cross-Modal Transfer[1]. It's the paper that earmarked him as a star, and look at the co-authors (Chris Manning and Andrew Ng).
[1] https://arxiv.org/abs/1301.3666 https://arxiv.org/abs/1301.3666
- raldi 8y agoOkay, so unsupervised learning would be if you had never seen any Earth animals before, and were presented with 99 photos of fish and one giraffe and noticed that the latter was the oddball, whereas zero-shot would be like if you were told that a giraffe was yellow and brown with four legs and a long neck and then said, "That must be a giraffe!" the first time you ever saw a photo of one.
- nl 8y agoYeah that's a reasonable way to look at it.