4 ms·
> OpenAI's latest model ... failed to meet the company's performance expectations ... particularly in answering coding questions outside its training data. So
by WorkerBee28474 2y ago
> OpenAI's latest model ... failed to meet the company's performance expectations ... particularly in answering coding questions outside its training data.
So the models' accuracies won't grow exponentially, but can still grow linearly with the size of the training data.
Sounds like DataAnnotation will be sending out a lot more LinkedIn messages.
- pton_xd 2y agoI thought I saw some paper suggesting that accuracy grows linearly with exponential data. If that's the case it's not a mystery why we'd be hitting a training wall. Not sure I got the right takeaway from that study, though. EDIT: here's the paper https://arxiv.org/abs/2404.04125 https://arxiv.org/abs/2404.04125