4 ms·
Yes - I believe the shift is coming. For inference especially, check out Groq’s chip design and its simplicity and speed compared to general purpose GPUs.
by anonomousename 3y ago
Yes - I believe the shift is coming. For inference especially, check out Groq’s chip design and its simplicity and speed compared to general purpose GPUs.