3 ms·
Avoiding the server call seems to only be time-efficient if calls to embed are time-efficient. The nice thing about server side inference is that you can use em
by nostrebored 2y ago
Avoiding the server call seems to only be time-efficient if calls to embed are time-efficient. The nice thing about server side inference is that you can use embedding models that can handle web-scale data independent of hardware
- kovezd 2y agoTime-efficiency is not the only metric to consider. Privacy, and offline mode are also important. Great tool for federated learning.