4 ms·
Yeah but those errors will decrease the chance that the output will end up spreading across the internet, and therefore decrease the chance that it ends up in a
by sebzim4500 3y ago
Yeah but those errors will decrease the chance that the output will end up spreading across the internet, and therefore decrease the chance that it ends up in a future training set.
You can see the whole process as a very high latency reinforcement learning system.
- aezart 3y agoThat's true but I think you're overestimating how careful people will be in their curation. There are tons of LLM-powered bots on twitter and reddit already, and no one is bothering to delete the output. Also, the curation process counts as "real human input" itself, so I don't think it contradicts my point.