3 ms·
> No company (not even Google) was able to make something better than GPT-4. GPT-4 Turbo, which was only released in November, is better than GPT-4 while havin
by p-e-w 3y ago
> No company (not even Google) was able to make something better than GPT-4.
GPT-4 Turbo, which was only released in November, is better than GPT-4 while having a much larger context. Don't be fooled by the fact that it's still called the same in marketing terms. It's a significant step forward, while coming only six months after GPT-4.
And "not even Google" is a strange phrase. Google hasn't been at the forefront of innovation anywhere in a long, long time.
> it's become clear that GPT-4-level intelligence might be the best we can extract from the current LLM technology
That's not clear at all. Where do you get this idea?
> and no one takes AGI seriously anymore.
Bollocks. LLMs are beating lawyers, doctors, and software engineers at post-university exams. We are galloping towards AGI.
What also happened in 2023 is that more than half a million H100s were installed globally, which are currently training the next-gen models you are guaranteed to hear about in the coming months. Compute capability is still growing at a stupendous pace, and there is no reason to expect that this won't lead to much more capable models.
- rvz 3y ago> Bollocks. LLMs are beating lawyers, doctors, and software engineers at post-university exams. We are galloping towards AGI. They sure are. Reality suggests otherwise: [0] [1] [2]. > What also happened in 2023 is that more than half a million H100s were installed globally, which are currently training the next-gen models you are guaranteed to hear about in the coming months. What if the new model performs worse than the current generation? There is no guarantee that it will be better and there's always a risk that the model will perform badly, meaning that tens of millions of dollars wasted over a single quarter. [3] [0] https://arstechnica.com/science/2024/01/dont-use-chatgpt-to-diagnose-your-kids-illness-study-finds-83-error-rate/ https://arstechnica.com/science/2024/01/dont-use-chatgpt-to-... [1] https://arstechnica.com/tech-policy/2023/06/lawyers-have-real-bad-day-in-court-after-citing-fake-cases-made-up-by-chatgpt/ https://arstechnica.com/tech-policy/2023/06/lawyers-have-rea... [2] https://www.trendmicro.com/en_za/devops/23/e/chatgpt-security-vulnerabilities.html https://www.trendmicro.com/en_za/devops/23/e/chatgpt-securit... [3] https://archive.is/wHYbn https://archive.is/wHYbn