4 ms·
I don’t understand this part: > In the current version, model inference is executed on the client’s CPU for low power consumption and widest device coverage.
by hrktb 6y ago
I don’t understand this part:
> In the current version, model inference is executed on the client’s CPU for low power consumption and widest device coverage.
Naively I would think model inference done server side would have the lower CPU power (from the client point of view) and widest device coverage (client does nothing more), what am I missing ?
- blauditore 6y agoProbably increased latency due to additional round trips to the server. Perhaps image streams are sent between clients directly, but I'm not sure.
- jonex 6y agoIt is done on the CPU instead of the GPU. GPU would seem like the natural choice for a convolution heavy model but was not used here for the mentioned reasons.
- hrktb 6y agoThanks, it makes sense
- Orphis 6y agoSome work needs to happen locally to show you a preview of what you're going to transmit, as it should for most video related work. If the segmentation is done server-side, then you need to sync it to the sender and reflect that quickly in the preview. It's probably not a great experience, at least for a launch.