3 ms·
Yes, I'm sure your "local AI" running on 8 gb of ram will be able to filter the ads added by the super computer AI just fine.
by const_cast 1y ago
Yes, I'm sure your "local AI" running on 8 gb of ram will be able to filter the ads added by the super computer AI just fine.
- maltelandwehr 1y agoI don't think that is too unrealistic. • Small models have performed really well in recent years. • Newer phones will have more RAM. • Private LLMs do not necessarily need to run locally.
- const_cast 1y agoIf it's not running locally, then by nature of what an LLM is it cannot be private. LLMs cannot act on encrypted information - the server must have access to all your plaintext prompts. And you simply are forced to trust they don't keep them forever, but they probably do.