4 ms·
Isn't this a sign that LLMs are self-cannibalizing? What data will LLMs be trained on when sites like StackOverflow die?
by pinus-cembra 9mo ago
Isn't this a sign that LLMs are self-cannibalizing? What data will LLMs be trained on when sites like StackOverflow die?
- ronbenton 9mo agoI have always wondered this. As more and more content on the internet becomes AI generated, does it become some kind of feedback loop where the hallucinations amplify themselves? Maybe someone smart can come along and help me understand the plan for this, if there is one.
- wang_li 9mo agoThey'll turn sites like wikipedia into free labor for training LLMs.
- Tostino 9mo agoYou are now often debugging problems directly in an LLM context window, providing back console output, error logs, etc. there is an absolute mountain of data to mine from developer chat logs.