3 ms·
The cloud is more efficient at utilizing hardware. Except for low-latency or low-connection requirements, the move to cloud will continue.
by acchow 2y ago
The cloud is more efficient at utilizing hardware. Except for low-latency or low-connection requirements, the move to cloud will continue.
- aurareturn 2y agoNo, there will be plenty of low value inference that won't be economical in the cloud. Apple Intelligence is one example.