3 ms·
> chatGPT is reportedly serving 10M customers and let's assume 10K tokens/month/user No way. Definitely too high once you remove their system prompts. > In on
by vineyardmike 3y ago
> chatGPT is reportedly serving 10M customers and let's assume 10K tokens/month/user
No way. Definitely too high once you remove their system prompts.
> In one year they have 12T tokens, while their original training set for GPT-4 was rumored to be 13T tokens.
This sounds great for understanding use, but the quality to train on seems terrible.
- visarga 3y agoYou might be right, a LLM alone doesn't improve by itself. But when it is part of a system like GPT's, then it can use web search, local RAG, code execution and also get human guidance and corrections. Clearly superior setup that improves over the LLM alone. I believe that is why OpenAI created GPT's, to lift a model at level N to level N+1.