2 ms·
From what I remember, these chips are not mobile size yet
by superb_dev 2mo ago
From what I remember, these chips are not mobile size yet
- bradfa 2mo agoA small model would be. I think that’s more the point. It’s definitely not SOTA but it’s fast and energy efficient and local.
- mdp2021 2mo ago> A small model would be [mobile size] A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?
- teaearlgraycold 2mo agoIs that analogue or are they baking floating points into the silicon?
- AlotOfReading 2mo agoIt's entirely possible they're using something like block floating point, where most of the hardware is simply fixed point. AMD's NPU does this, for example.
- wmf 2mo agoNope, a small model would be larger than the whole iPhone SoC.