3 ms·

Especially since it only has like 8 MB of memory I think?

• geerlingguy 3y ago
  Some SoCs even have competent built in NPUs, too, but software support is severely lacking. PyCoral and Coral hardware development seems glacial lately :( They have enjoyed a lot of momentum... I wish they could release a follow-up version and get some longstanding software issues resolved.
  • deleted 3y ago
    [deleted]
  • orangepurple 3y ago
    Orange Pi 5 has RK3588 with a neural processing unit (NPU). SDKs for it https://github.com/rockchip-linux/rknpu2 https://github.com/rockchip-linux/rknpu2 https://github.com/rockchip-linux/rknn-toolkit2 https://github.com/rockchip-linux/rknn-toolkit2 Quickstart and usage guide: https://wiki.t-firefly.com/en/ROC-RK3588S-PC/usage_npu.html https://wiki.t-firefly.com/en/ROC-RK3588S-PC/usage_npu.html
    • ThatPlayer 3y ago
      One of the most popular uses I've seen for Coral, Frigate for object detection for security cameras, recently added support for the RK3588 NPUs too: https://github.com/blakeblackshear/frigate/pull/8382 https://github.com/blakeblackshear/frigate/pull/8382 . I think it requiring a RK3588 makes it a bit annoying to have to upgrade your entire setup just for this though.
      • orangepurple 3y ago
        How many camera feeds can one Orange Pi 5 realistically monitor?
        • ThatPlayer 3y ago
          According to the author of that PR, they're using 10% of 1 NPU core on 3 cameras: https://github.com/blakeblackshear/frigate/pull/8382#issuecomment-1785953476 https://github.com/blakeblackshear/frigate/pull/8382#issueco... The bottleneck instead will probably be the video stream decoding speed, especially as the SoC's hardware decoder isn't being used yet.