4 ms·
This business model is bound to get attacked and suffer a painful exit soon. Here's why: First, the whole systems of chips architecture that everyone is talkin
by vinay_ys 3y ago
This business model is bound to get attacked and suffer a painful exit soon. Here's why:
First, the whole systems of chips architecture that everyone is talking about will solve for increasing overall SRAM available to keep more model state on super fast memory and avoid going to slow memory.
Secondly, anyone serious about their data (enterprises) won't be okay with making API calls to Groq. Anyone serious about their data and have a lot scale (consumer internet) won't also be okay with making expensive API calls to Groq at scale.
Their cloud is attractive only if I can use their API for experimentation toy apps to continue developing in this direction while the rest of the major industry players systems of chip architecture catches up and solves for SRAM size bottleneck and manufacturing process bottleneck, and once that's solved, I get more powerful compute for cheaper $$ to deploy on-prem.
So, this cloud strategy is short-lived. I see another pivot on the horizon.
- sebastiennight 3y agoThe same has been said of OpenAI for a couple of years now (that they're just a platform to prototype on before moving on to open source models)... ... and yet, they're still leading the field. I think it's a bit early to think the field is getting commoditized yet.
- frozenport 3y ago>> won't be okay with making API calls to Groq Linked article: If customers come with requests for high volumes of chips for very large installations, Groq will instead propose partnering on data center deployment