3 ms·
That's how Groq works. A cluster of LPUv2s would probably be faster and cheaper than an Infiniband cluster of Epycs.
by wmf 11mo ago
That's how Groq works. A cluster of LPUv2s would probably be faster and cheaper than an Infiniband cluster of Epycs.
- fooblaster 11mo agowhat is an lpuv2
- wmf 11mo agoThe chip that Groq makes.
- dpe82 11mo agoYeah I'm familiar; I was hoping I could do something related on previous generation commodity(ish) hardware. It didn't work but I learned a ton.