3 ms·
Does anyone know what "zero-shot" means in this context? Even the blog post doesn't mention it outside the title.
by stevage 3y ago
Does anyone know what "zero-shot" means in this context? Even the blog post doesn't mention it outside the title.
- omneity 3y agoThat would mean most likely that the video is the result of a prompt without any example. Illustrated examples from how Google does it here: https://blog.research.google/2023/11/zero-shot-adaptive-prompting-of-large.html https://blog.research.google/2023/11/zero-shot-adaptive-prom... EDIT: corrected answer factuality.
- stevage 3y agoI wonder why "zero-shot" rather than "one-shot".
- omneity 3y agoI was wrong indeed, this is technically called zero-shot prompting. Zero-shot prompting here means without an example, i.e. "show me a panda on a skate". The opposite would be few-shot prompting, "write me a limerick like these 5 examples".
- hyperparticles 3y agoIn addition, there are some tasks that the model can do and was never trained on, see the newly added paper link in the website.
- busssard 3y agoi interpret it that the VideoPoet has not seen the things prompted. One shot means you show it one example of something and it generates equivalents. However i find it very misleading, as the training data is most likely gigantic. So it is not very accurate calling it zero shot
- stevage 3y agoAh, thanks, that makes sense.
- hyperparticles 3y agoAuthor here. We demonstrate zero-shot capability on a few tasks by chaining smaller tasks together. For example, the model was never trained on text-to-audio but we can do it by generating text-to-video followed by video-to-audio. We just added a link to the paper in the website, you can read more about it.