4 ms·

Something like the GPTs from openai that I can run locally without being hosted in the cloud

• iiJDSii 3y ago
  Out of curiosity what are the use cases/benefits for running models locally? I also have this fascination because I'd like to have my LLM exist like a 'pocket calculator' that's safe from any technical fiasco in the future... But aside from this I'm wondering why others are into this as well.
  • vunderba 3y ago
    The benefit is data ownership instead of sending it off to a third-party who does God knows what to it.
  • smcleod 3y ago
    Latency, customisation, privacy, cost, availability.