3 ms·
Aren't these things supposed to have cores dedicated to ml?
by __loam 3y ago
Aren't these things supposed to have cores dedicated to ml?
- brucethemoose2 3y agoThey are not as fast as the GPU (but much lower power). Also, not many implementations can even use it.
- azinman2 3y agoYou’re thinking of the neural engine. I’m not sure that llama.cpp makes use of this. They’d have to turn it into a CoreML model to do so.