3 ms·

Out of curiosity what are the use cases/benefits for running models locally? I also have this fascination because I'd like to have my LLM exist like a 'pocket

Out of curiosity what are the use cases/benefits for running models locally? I also have this fascination because I'd like to have my LLM exist like a 'pocket calculator' that's safe from any technical fiasco in the future... But aside from this I'm wondering why others are into this as well.

vunderba 3y ago
The benefit is data ownership instead of sending it off to a third-party who does God knows what to it.
smcleod 3y ago
Latency, customisation, privacy, cost, availability.