4 ms·
A beautiful thought, except that Attention Is All You Need came out in 2017. ChatGPT was when the hype cycle kicked off, but I guarantee there were LLM-generate
by dTal 3y ago
A beautiful thought, except that Attention Is All You Need came out in 2017. ChatGPT was when the hype cycle kicked off, but I guarantee there were LLM-generated comments on it before then, possibly from nation-state-funded propaganda mills - not to mention other, less sophisticated bots.
- treprinum 3y agoYes, but the real human-like comments were possible only with ChatGPT and I doubt the startups that got GPT-4 early access in 2022 used it to generate Reddit comments. These days a self-hosted Vicuna-LLaMa-13B is good enough to write MBA essays so anything published in 2023 is a suspect.
- dTal 3y agoYou don't know that a nation state didn't make something ChatGPT level earlier.
- treprinum 3y agoI doubt it as I was in touch with OpenAI when they were making GPT-4 available last year to their preferred partners. Governments rely on these companies and lag in their capabilities these days.