3 ms·
I wonder what happens when the majority of the Internet is bullshit generated by LLMs (which can't be long, surely), which is then used to train the latest LLMs
by hermitcrab 3y ago
I wonder what happens when the majority of the Internet is bullshit generated by LLMs (which can't be long, surely), which is then used to train the latest LLMs. Will we pass an LLM bullshit horizon where the entire Internet becomes "iollotte sserotgomar" and it's brethren?
- myaccountonhn 3y agoI guess we always feared ai would train on itself and become super smart, turns out the opposite happens
- smsm42 3y agoI guess that's the "singularity" we've been told about - when the amount of bullshit is so massive that it completely overwhelms any attempts at making sense of anything online or find anything.
- hermitcrab 3y agoYes, singularlity is a good word to use. I wrote up my thoughts here: https://successfulsoftware.net/2024/02/18/the-ai-bullshit-singularity/ https://successfulsoftware.net/2024/02/18/the-ai-bullshit-si... HN thread: https://news.ycombinator.com/item?id=39422528 https://news.ycombinator.com/item?id=39422528
- stavros 3y agoIIRC, the quality takes a dive when an AI is uncritically trained on its own output.