5 ms·
>but saves companies quite some money That's all that matters to companies.
by jplusequalt 3y ago
>but saves companies quite some money
That's all that matters to companies.
- k__ 3y agoUntil they can't find seniors anymore.
- visarga 3y agoAI is going to be in a different place in 5 or 10 years.
- kjkjadksj 3y agoThats what they were saying about crypto too
- k__ 3y agoHopefully. However, I had the impression there doesn't exist enough training data to make that place different in a meaningful way. Still, I think, letting some skilled UX designers loose on input methods could improve things quite a bit, even if the models won't get "smarter".
- visarga 3y agoI did a back-of-the envelope calculation, OpenAI has 100M monthly active users, assume 10K tokens per user per month usage ($20 would pay for 600K tokens on the API) then they generate 1T tokens per month. This dataset would be focused on human interests (in domain for users) and containing AI errors (in domain for the model). It's LLM empowered with human in the loop and tools - code execution, search, APIs. So it is a good basis for the next dataset. I think OpenAI has amassed about as much chat log text as there is organic data was used for GPT-4, which was rumoured to be 13T tokens. It's surprising how much synthetic data can be generated per year. And OpenAI can do this with human in the loop for free, if the paying users pay for everyone. We then benefit 6-12 months later when the open source models trained with data exfiltrated from OpenAI models catch up.