3 ms·
The H100 at this point includes just the bare minimum hardware to be considered a GPU. As long as AI is primarily matrix multiplication, GPUs are going to be ne
by kcb 3y ago
The H100 at this point includes just the bare minimum hardware to be considered a GPU. As long as AI is primarily matrix multiplication, GPUs are going to be near ideal.
- Dylan16807 3y agoIt's still spending most of its space on generic floating point units. And there's no hardware support for compressed weights as far as I know.
- moffkalast 3y agoIt is on Groq's LPU units iirc.