2 ms·
> GPUs Groq will still come out on top because you can never reduce latency by adding more parallel compute :) You literally can, in fact that’s the entire rea
by deepnotderp 3y ago
> GPUs Groq will still come out on top because you can never reduce latency by adding more parallel compute :)
You literally can, in fact that’s the entire reason to use multiple chips.
See eg the TPU group’s paper: https://arxiv.org/abs/2211.05102 https://arxiv.org/abs/2211.05102