3 ms·
It tells me that they have some kind of insider knowledge that the models have hit their limits and won't be getting much better, and it makes sense economicall
by dyzone 2mo ago
It tells me that they have some kind of insider knowledge that the models have hit their limits and won't be getting much better, and it makes sense economically speaking to just bake the current models and use them for the next 5-10 years. Looks like we're near the top of the S curve.
- hahahaa 2mo agoA model you can run for practically no cost is a new proposition. It is the CPUification of AI. Sure there be supercomputers but you PC will be pretty super too.
- mountainriver 2mo agoWhat would possibly tell you that?
- deleted 2mo ago[deleted]
- Maxion 2mo agoExpensive as fuck to make chips, only makes sense if you believe whatever model you're creating a chip out of will not become completely irrelevant in 5-10 years.
- niek_pas 2mo agoThere’s lots of use cases where the current models do fine though. A chip that can run a current cheap model at 100x would be amazing for things like detecting prohibited content on Facebook. You don’t need the 2030 equivalent of Fable for that, you need something that can cheaply process insane numbers of posts per day.
- IshKebab 2mo agoNo, it makes sense if whatever model you're creating a chip out of will not be irrelevant in 5 years even if it is much much faster & cheaper. There are probably limited applications but not zero.
- mountainriver 2mo agoThat’s not what we are empirically seeing though. There is also no way of knowing that things can’t be progressing for the next 5 years. No foundational model company would be spending the amount they are on research if they thought it wasn’t going to pan out
- fsloth 2mo agoI’m not sure we are at the top. Swarmed lower tier models appear to scale up in competence. So something like a Fable swarm running at 100x the speed might provide surprises. But ”top of the curve reached” feels like the likelier scenario.
- azernik 2mo agoNo knowledge (insider or otherwise) is needed — could just be a bet, hedged against all the other bets a company AMD's size makes.