4 ms·
Ignoring the associate debacle, the characterization of large language models as “stochastic parrots”[1] is the most accurate description I think I’ve ever hear
by cgearhart 5y ago
Ignoring the associate debacle, the characterization of large language models as “stochastic parrots”[1] is the most accurate description I think I’ve ever heard for the capabilities of AI language models. These models don’t understand that a mistake on a Winograd question is not the same as a mistake on a medical diagnosis (as a contrived example).
[1] https://dl.acm.org/doi/10.1145/3442188.3445922 https://dl.acm.org/doi/10.1145/3442188.3445922
- visarga 5y agoI don't think it's a good name. GPT-3 is more like a dreaming hallucination machine. Humans do nonsensical things in their dreams, same kind of non sequitur as the language models. What GPT-3 lacks is being able to wake up from its disembodied hallucinations, in other words a body and something to motivate its actions.