3 ms·
> A small model would be [mobile size] A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?
by mdp2021 3mo ago
> A small model would be [mobile size]
A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?
- teaearlgraycold 3mo agoIs that analogue or are they baking floating points into the silicon?
- AlotOfReading 3mo agoIt's entirely possible they're using something like block floating point, where most of the hardware is simply fixed point. AMD's NPU does this, for example.