You can already run some models on the NPUs in the Rockchip RK3588 SBCs which are pretty abundant. A claude 4.6 they are most certainly not, but if you get thr

You can already run some models on the NPUs in the Rockchip RK3588 SBCs which are pretty abundant. A claude 4.6 they are most certainly not, but if you get through the janky AF software ecosystem they can run small LLMs reasonably well with basically zero CPU/GPU usage