3 ms·
There won't ever be newer training data. The OG data came from sites like Stackoverflow. These sites will stop existing once LLMs become better and easier to u
by otabdeveloper4 8mo ago
There won't ever be newer training data.
The OG data came from sites like Stackoverflow. These sites will stop existing once LLMs become better and easier to use.
Game over.
- esclerofilo 8mo agoEvery time claude code runs tests or builds after a change, it's collecting training data.
- co_king_5 8mo ago[dead]
- esclerofilo 8mo agoI can't pretend to know how things work internally, but I would expect it to be involved in model updates.
- otabdeveloper4 8mo agoYou need human language programming-related questions to train on too, not just the code.
- 8note 8mo agothats what the related chats are for?
- otabdeveloper4 8mo agoAnd now you're training LLMs on LLM output. No, you need something like Stackoverflow. The crowdsourced ratings system that Stackoverflow has (had?) is the crucial part.