2 ms·
Groq and Cerebras only make sense at massive scale which is why I guess they pivoted to being API providers so they can amortize the hardware over many customer
by wmf 2y ago
Groq and Cerebras only make sense at massive scale which is why I guess they pivoted to being API providers so they can amortize the hardware over many customers.
- latchkey 2y agoCorrect except that massive scale doesn't work cause it just uses up exponentially more power/space/resources. They also have a very limited use case... if things ever shift away from LLM's and into another form of engineering that their hardware does not support, what are they going to do? Just keep deploying hardware? Slippery slope.