2 ms·
Given how every CPU vendor seems to push for some kind of NPU, local running models will probably be far more common in next 5 years. And convincing everyone t
by PunchyHamster 11mo ago
Given how every CPU vendor seems to push for some kind of NPU, local running models will probably be far more common in next 5 years. And convincing everyone to pay subscription for very minimal improvements in functionality gonna be hard.
- ac29 11mo agoThe NPUs integrated into CPU SoCs are very small compared to even integrated GPUs, much less discrete or datacenter GPUs. NPUs seem to be targeted towards running tiny ML models at very low power, not running large AI models.