3 ms·
The novelty of GPT3 is its few shot learning capabilities. GPT3 shows a new, previously-unknown, and, most importantly, extremely useful property of very large
by neurologic 6y ago
The novelty of GPT3 is its few shot learning capabilities. GPT3 shows a new, previously-unknown, and, most importantly, extremely useful property of very large transformers trained on text -- that they can learn to do new things quickly. There isn't any ML researcher on record who predicted it.
- ricksharp 6y agoYes, the emergent ability to understand commands mixed in with examples is pretty crazy.
- MiroF 6y ago> There isn't any ML researcher on record who predicted it. That's just absurd - this was an obvious end-result for LM. NLP researchers knew that something like this was absolutely possible, my professor predicted it like 3 years ago.