3 ms·
It's still spending most of its space on generic floating point units. And there's no hardware support for compressed weights as far as I know.
by Dylan16807 3y ago
It's still spending most of its space on generic floating point units. And there's no hardware support for compressed weights as far as I know.
- moffkalast 3y agoIt is on Groq's LPU units iirc.