snhbsqub

4 ms·

1. 1.▲
   by snhbsqub 2y ago

   - Groq has exactly 0 dollars in revenue - Groq requires 576 chips to run a single model - Groq can do low latency inference, but can't handle batches, and can't run a diversity of different models on each deployment - Groq quantiz
2. 2.▲
   by snhbsqub 2y ago

   Groq quantize their models, killing accuracy. SambaNova run the models at full precision, and on a single node, whilst Groq runs a single model on hundreds of chips. SambaNova run training and inference, Groq only run inference. SambaNova r
3. 3.▲
   by snhbsqub 2y ago

   Let me know how that goes.
4. 4.▲
   by snhbsqub 2y ago

   SambaNova is the only one if the chip startups that is viable. It surprises me that people don’t see this.
5. 5.▲
   by snhbsqub 2y ago

   Groq makes zero revenue, needs hundreds on chips to run 1 model, and runs everything at lower precision. SambaNova has a lot of revenue, and runs at that speed at full precision on a single node. It really isn’t a competition.
6. 6.▲
   by snhbsqub 2y ago

   How are they lagging? They are running faster than anyone else at full precision and with many many fewer chips than Groq. Groq is not real.