3 ms·
> So much for a plateau lol. It’s been really interesting to watch all the internet pundits’ takes on the plateau… as if the two years since the release of GPT
by throwup238 2y ago
> So much for a plateau lol.
It’s been really interesting to watch all the internet pundits’ takes on the plateau… as if the two years since the release of GPT3.5 is somehow enough data for an armchair ponce to predict the performance characteristics of an entirely novel technology that no one understands.
- jgalt212 2y agoYou could make an equivalently dismissive comment about the hypesters.
- throwup238 2y agoYeah but anyone with half a brain knows to ignore them. Vapid cynicism is a lot more seductive to the average nerd.
- bandwidth-bob 2y agoThe pundits response to the (alleged) plateau was proportional to the certainty with which CEOs of frontier labs discussed pre-training scaling. The o3 result is from scaling test time compute, which represents a meaningful change in how you would build out compute for scaling (single supercluster --> presence in regions close to users). Thus it is important to discuss.
- deleted 2y ago[deleted]