3 ms·

100s of chips for who knows how many clients. The mobile phone will have to do calculations just for 1 client.

• tome 3y ago
  Yes, we pipeline requests so multiple users are being handled by the same hardware at one time.
  • mrtksn 3y ago
    Thanks for the clarification. So, would you say that Groq has a potential to have let's say OpenAI speeds on handheld devices at reasonable energy consumption? Or is that not really what this tech's strength is maybe?
    • tome 3y ago
      The industry as a whole is a very long way away from that. The power requirements are too high for mobile.