3 ms·
It's really hard to compare Movidius with anything else because there are so few published benchmarks. A few notes though: Movidius is inference only. That mi
by nl 9y ago
It's really hard to compare Movidius with anything else because there are so few published benchmarks.
A few notes though:
Movidius is inference only. That might be useful if you have the specific requirements that needs low power, high speed inference and also somehow has to have a x86 CPU.
If you want high speed, low power inference and don't need x86 then the NVidia Jetson wipes the floor with it.
If you want low speed (~2 inference/second), low power then RPi is a good option.
If you want high speed, you need GPU(s).
- aseipp 9y agoThe Movidius Stick supports the Raspberry Pi now as a deployment (not development) option, so you can get low power and high speed inference on a single RPi. I have one of these on my desk and they're neat but I haven't done much with it yet. I did grab one because I had heard it would support RPis, though. Granted, it's 2x the price of a Rpi 3. All together that's about $100 USD. And NVidia just announced the TX1 SE Devkit at $200 USD. I have a TX2, but the TX1 will definitely do better at a higher power/size profile. The MCS only supports Caffe as well, while the TX1/TX2 will support a wider array of DL frameworks (as well as FP16 support since it's a Tegra).
- nl 9y agoInteresting. I didn't realize they would work on a RPi. Movidius have promised TF support I think.
- FractalNerve 9y agoThank you for the great answer Nick, that's the best summary I could've hoped for! So in summary: ⇒ low power, high speed inference on x86 CPU 🡺 Intel Movidius ⇒ low power, high speed inference non x86 🡺 NV Jetson ⇒ low power, low speed inference 🡺 RPi and similar ⇒ high power, high speed inference 🡺 GPU(s) NVidia Jetson is the obvious winner, if there is no viable alternative, however Jetson is quite expensive and therefore I can't go that route. I want to speed up training & inference. eGPUs are more or less affordable, but low power training & inference at medium or low-cost would strike me as a clear winner. Sorry for the late answer, nonetheless, even though I didn't get an alternative DSP that offers similar advantages as Movidius, I'm still grateful for your insightful comment.
- nl 9y agoYes, GPUs (or cloud) are the way to go at the moment if you have any training and want it quick. HOWEVER, If you are careful, for some models you can get cost benefits by training on cloud CPUs. See http://minimaxir.com/2017/07/cpu-or-gpu/ http://minimaxir.com/2017/07/cpu-or-gpu/