4 ms·
This looks very neat. Do you think something like a Jetson Nano would be able to handle inference locally?
by omgwtfbyobbq 6y ago
This looks very neat. Do you think something like a Jetson Nano would be able to handle inference locally?
- calebkaiser 6y agoThanks! The short answer is that I don't know, as it's only been run on EC2 instances, but given its current compute needs, probably not. The longer answer is that this project has a ton of room for optimization, some of which is mentioned in the repo, and with lower latency requirements + optimizations, I don't see why it wouldn't work on less powerful hardware (I've never personally worked with the Jetson Nano, so I don't want to speak with any false confidence on it specifically).
- hadeson 6y agoI guess object detection is the bottleneck of the pipeline, which highly optimized YOLOv4-tiny[0]could get to 39 FPS on Jetson Nano. Also camera decoding with Nvidia Deepstream is a lot faster than OpenCV. [0] https://github.com/pjreddie/darknet/issues/2201 https://github.com/pjreddie/darknet/issues/2201