3 ms·
I expect it to happen. If GPT5 bombs, then I’ll reset my expectations. I consider models like Claude Sonnet 3.5 and LLama 405b as GPT4 class models. I don’t t
by aurareturn 2y ago
I expect it to happen. If GPT5 bombs, then I’ll reset my expectations.
I consider models like Claude Sonnet 3.5 and LLama 405b as GPT4 class models.
I don’t think we’ve seen a true successor to GPT4 yet with all the technique learnings and 100x the compute.
- lolinder 2y agoThat we haven't yet seen the successor is why I'm suspicious we're leveling out. OpenAI teased their new model for months and willingly let the media assume it was GPT-5, then released it as 4o because it was faster and cheaper but no better. They intentionally burned a lot of the hype for GPT-5 on a different, less exciting product—that's not a move you make if you have a clear path towards the next generation.
- Animats 2y ago> That we haven't yet seen the successor is why I'm suspicious we're leveling out. Not clear if we're leveling out on what's possible, but price/performance may be increasing with model size. There's an economic limit. If the main way to fix hallucinations is to run the same query many times and look for consensus, that's going to be expensive.