5 ms·
This functionality seems to have been removed for legal compliance, so that doesn't seem like it would have helped?
by jefftk 4y ago
This functionality seems to have been removed for legal compliance, so that doesn't seem like it would have helped?
- itronitron 4y agoBy versioned software I mean the kind of software that companies can't interfere with after a consumer purchases it.
- yifanl 4y agoI assume it's not currently practical to bundle the current version of the LLM into something fully in the client? Could be wrong though.
- kridsdale1 4y agoIt depends how much quality you want. Wolfram writes about experimenting with GPT2 which can run on his PC.
- jefftk 4y agoSo not just versioned (which cloud software often is) but running locally? That's a pretty poor fit for a large language model, since users won't have sufficient hardware and use is very bursty.
- mejutoco 4y agoThey might be able to copy the model weights, if running locally.
- kridsdale1 4y agoNot yet. In a few years, consumer GPUs or dedicated ML units (which Apple SOCs have) and local storage and ram will be large enough to run “a few years old” LLMs. The cutting edge will always be in the cloud but a market for personal AI does exist.