3 ms·
Sorry, should have mentioned "if you have access to Shenzhen" in my post :) What I have in mind is something like RK3399Pro, it has a proprietary NPU at roughl
by rfoo 6y ago
Sorry, should have mentioned "if you have access to Shenzhen" in my post :)
What I have in mind is something like RK3399Pro, it has a proprietary NPU at roughly 3Tops / 1.5W (on paper). But its toolchain is rather hard to use. Hisilicon had similar offerings. There are also Kendryte K210 which claims 1Tops @ 0.3W but I haven't get any chance to try it.
I was already playing with RK3399Pro When Edge TPU was announced, life is tough when you had to feed your model into a blackbox "model converter" from the vendor. That's the part I hope Edge TPU excels at. But months later I was greeted by... "to use Edge TPU, you have to upload your TFLite model to our online model optimizer", which is worse!
- simcop2387 6y agoThere's now a blackbox compiler that doesn't have to run on their service, but it's basically the same as all the others now because of that.
- my123 6y agoOn Xavier, the dedicated AI inference block is open source hardware. Available at http://nvdla.org/ http://nvdla.org/