4 ms·
Have there been compelling use cases for on device LLMs where the value isn’t based on privacy benefits yet?
by zaptrem 2y ago
Have there been compelling use cases for on device LLMs where the value isn’t based on privacy benefits yet?
- polyomino 2y agoLower latency, which can be useful for live translation or keyboard autocomplete
- Tepix 2y agoFor me complete privacy is a must-have for an LLM that gets access to pretty much all my data (mails, calendar, location, browser history, chats, address book, health, app use, ...). But there are other benefits such as the availability, even when your phone is offline, latency and no cost per use.