5 ms·
It's interesting how they say that their model has high "zero-shot" performance, even though it was trained on millions of examples. To me, zero-shot would mea
by j7ake 3y ago
It's interesting how they say that their model has high "zero-shot" performance, even though it was trained on millions of examples.
To me, zero-shot would mean a model whose parameters was never tuned through training examples at all...
- p1esk 3y agoZero shot means a model trained one one dataset, or for one task, performs well on another dataset, or on another task - without any finetuning.
- adastra22 3y agoThanks for the clarification, because that is NOT what zero shot used to mean in AI.
- whiplash451 3y agoWhat did it use to mean?
- adastra22 3y agoBasically the ability to perform a task on the first try, without any feedback. E.g. a robot that is trained to pick up blocks being told to shoot a basketball though a hoop, and making a reasonable attempt at doing so on the first try (doesn't have to be successful, but has to in some way resemble throwing a ball through a hoop rather than picking up blocks). I can see how the machine learning definition is similar, but the whole idea of retraining and fine-tuning is foreign to a lot of subfields in GOFAI.
- optimalsolver 3y agoSo a model trained on one task, performing reasonably well on an related task?
- adastra22 3y agoYeah sorry I didn’t mention the important difference, which had me surprised. One shot learning in traditional AI is (to use modern terms), one shot training. The AI doesn’t just do the thing in the first try, it learns from that inference as well and does the thing even better on the second try. I guess attentional context is almost this, but LLMs don’t update their base model after a one shot inference.
- p1esk 3y agoHow do you train a robot in GOFAI?
- deleted 3y ago[deleted]
- breakds 3y agoIn this context, "zero-shot" capability usually means "how well it performs without fine-tuning or prompting with in-context examples" after the model is trained and parameters frozen.