4 ms·
Even worse optics. They scaled the training compute by 100x and got <1% improvement on several benchmarks.
by bigmadshoe 1y ago
Even worse optics. They scaled the training compute by 100x and got <1% improvement on several benchmarks.
- reasonableklout 1y agoIs 1% relative to more recent models like o3, or the (old and obsolete at this point) GPT-4?
- bigmadshoe 1y agoIt was relative to the number the comment I replied to included. I would assume GPT-5 is nowhere near 100x the parameters of o3. My point is that if this release isn't notable because of parameter count, nor (importantly) performance, what is it notable for? I guess it unifies the thinking and non-thinking models, but this is more of a product improvement, not a model improvement.
- Mentlo 1y agoIt is almost as if there’s a documented limit in how much you can squeeze out of autoregressive transformers by throwing compute at it