2 ms·
Yes, we pipeline requests so multiple users are being handled by the same hardware at one time.
by tome 3y ago
Yes, we pipeline requests so multiple users are being handled by the same hardware at one time.
- mrtksn 3y agoThanks for the clarification. So, would you say that Groq has a potential to have let's say OpenAI speeds on handheld devices at reasonable energy consumption? Or is that not really what this tech's strength is maybe?
- tome 3y agoThe industry as a whole is a very long way away from that. The power requirements are too high for mobile.