3 ms·
> Meanwhile OpenAI, Anthropics, trains on AI generated data to improve their models, and it works. They got a secret ace in their pocket - chat logs created wi
by visarga 2y ago
> Meanwhile OpenAI, Anthropics, trains on AI generated data to improve their models, and it works.
They got a secret ace in their pocket - chat logs created with human in the loop. Of course those might still have errors, but much fewer. They can infer from a human response if it was accepted or not.
I think OpenAI generates at least 1B sessions per month and 2 Trillion interactive tokens. Those can go into the LLM again for analysis and synthetic content generation, or for RLHF with the whole conversation as guidance. Having access to the following interactions can shed light on previous answers.
Even more, they can correlate chats across days, presumably humans try out LLM ideas in reality and return for iteration. That way LLMs indirectly get real world grounding.
- mrbungie 2y agoThis is likely one of the main reasons why they're offering ChatGPT for free and running ChatGPT Plus at a loss.
- apwell23 2y ago> main reasons why they're offering ChatGPT for free and running ChatGPT Plus at a loss. As opposed to what though? Its not like there a huge demand for these apps that they can charge money. They have no option but to give it away for free .
- LordDragonfang 2y agoAre you not aware that half the industry is using it to generate (at least some portion of) their code? And that many are paying for the privilege?
- apwell23 2y agoYes I pay for it. Not sure what your point is. I didn't say no one in the world pays for it. Are you not aware of flatlining user growth? or are you under the impression that coders paying for these apps are enough to make them profitable? https://www.thewrap.com/chatgpt-growth-2024/ https://www.thewrap.com/chatgpt-growth-2024/
- astrange 2y agoThey can't directly train on chat transcripts, because they contain private information and other things you don't want appearing in answers. I doubt they even look at them unless you press the thumbs down, in which case they probably use it in some indirect way. They might try to look for trends or what questions are popular of course.
- ipaddr 2y agoThat's exactly what they are doing and what you agreed to ans why some use other models or running something locally.
- fantasybuilder 2y agoHaha, exactly. I switched to local Llama 3 and never looked back.
- astrange 2y agoIf they were training on other people's chat transcripts, the answers would read like how other people type, instead of telling you to delve mystically into intriguing questions.
- ipaddr 2y agohttps://help.openai.com/en/articles/5722486-how-your-data-is-used-to-improve-model-performance https://help.openai.com/en/articles/5722486-how-your-data-is... Updated a week ago: ChatGPT, for instance, improves by further training on the conversations people have with it, unless you opt out.
- astrange 2y agoEasier to write that than explain their internal processes. But what would be the point? Training on someone asking a question doesn't cause it to learn the correct answer.