3 ms·
> wait - this isn't on a Raspberry Pi? Literally the first sentence of my post. You and many others seem to forget that I explicitly stated I wanted 4 HD str
by staycoolboy 6y ago
> wait - this isn't on a Raspberry Pi?
Literally the first sentence of my post.
You and many others seem to forget that I explicitly stated I wanted 4 HD streams at 30fps from my home IP address.
> but the time taken should presumably be dominated by the neural network object detection
There is a lot more to a pipeline than just inference.
The problem is aggregating the video streams, downsampling, submitting for inference, and then activating the Gstreamer element to write the MPEG. Most of this can use the nvidia memory properties on the nv* elements, which is great! However eventually you need to copy out for the Arm core. 4 HD streams is a lot of work for a small Arm core. The basic Gstreamer elements do not use the ACL AFAIK. I did recompile them with ORC optimization, but I'm not too familiar how/if that uses ACL/NEON. And the one that I built is basically just a bus messaging system for the downstream codec pipeline that is flagged by the tracker.
Can you point me to the benchmark in your link [#2] that indicates Python & C++ have the same performance? Nvidia does have an advantage in that Tensorflow-gpu supports them natively, but that is just for inference. I only see one table and the comments explicitly state they use the DS SDK and -not- TFlow.