I’ve been trying to use rknn on RK3588 boards (which can go a bit higher in wattage due to the rest of the SOC and peripherals), and I get your point, but the o

I’ve been trying to use rknn on RK3588 boards (which can go a bit higher in wattage due to the rest of the SOC and peripherals), and I get your point, but the overall landscape for non-GPU accelerators is still pretty much… just plain bad. I’m hoping for Ryzen APUs to be a good stopgap for larger models, or for enough support for Mali GPUs (which can add a little more compute) to be more usable, but in general, you have a huge abyss between “oh, that’s a face in that picture” and “here’s my current estimation of movement for this human”.