22 ms·

Love that use case :) re your point about latency, that is one of the main reasons we are doing all the inference on the cloud. Almost all deep learning models

Love that use case :) re your point about latency, that is one of the main reasons we are doing all the inference on the cloud. Almost all deep learning models (at least CV models) need GPU to run with low latency. That's true that if you have set up an automated response from another device, it may still work if the internet is down but for alerting the user, you would still need internet connection even with a central hub...

pilooch 7y ago
FTR, a simple RPi4 yields ~4FPS on a DL object detection model. You may need cloud for your central hub, but neural network inference can be done locally.
- mrafiee 7y ago
  By 4FPS do you mean 250ms latency per frame? What OD model specifically did you get that latency from on RPi4?