2 ms·
There is virtually no question they are doing inference at the edge. I have worked on edge AI systems, and I would simply assert that there is no other economi
by voakbasda 2mo ago
There is virtually no question they are doing inference at the edge. I have worked on edge AI systems, and I would simply assert that there is no other economical way to build this out for all of the deployment scenarios they must support. Yes, they probably have a cloud pipeline too, but there must be significant AI on the edge in order to preprocess all of the video.
- fwipsy 2mo agoYou're right. I didn't think that through. Actually, that's probably the stupidest thing I said all day. (I hope so, anyways.) However, I'm skeptical that 32GB RAM is necessary for what they do on the edge. Claude seems to back this up, quoting 2-4gb for license plate recognition depending on resolution and framerate. but I'm open to correction here.