3 ms·
Interesting that the author, who supports the "stochastic parrot" interpretation, still works on GPT detection. If it's just a stochastic parrot, surely it will
by visarga 4y ago
Interesting that the author, who supports the "stochastic parrot" interpretation, still works on GPT detection. If it's just a stochastic parrot, surely it will be trivial to detect, and its outputs useless anyway.
> One of the most immediate is how to make AI output detectable as such, in order to discourage its use for academic cheating as well as mass-generated propaganda and spam. As I’ve mentioned before on this blog, I’ve been working on that problem since this summer
I don't really know what a "stochastic parrot" is supposed to mean. It is an LLM that can do 1000 NLP tasks, or a glorified Markov Chain word salad factory?
It's also a bad term: demeaning to parrots - they can reproduce and don't need our help to survive, and demeaning to LLMs that can actually do more than parroting - they generate novel text that makes sense. Gebru really did a number on NLP, inventing such an insulting name, no wonder she was kicked out, I wouldn't want her in my team, she would just piss on any idea.