3 ms·
Are you implying that running an LLM locally means having no ability to audit security vs running one "in the cloud"? Seems like the opposite to me.
by daveguy 3y ago
Are you implying that running an LLM locally means having no ability to audit security vs running one "in the cloud"? Seems like the opposite to me.
- belltaco 3y agoI think they meant people trust the web enough to use it for most of their activities so the ability to audit security in a local LLM may not be a big selling point.
- UncleMeat 3y agoNo the point is that I'm already doing basically all of my computing (both work and non-work) via web applications. All of the AI integrations into products can happily run on backends rather than locally on my machine. There are exceptions, of course, but this is the state of the bulk of modern computing.
- itsoktocry 3y ago>having no ability to audit security vs running one "in the cloud"? Seems like the opposite to me. By "ability" I mean, literally, ability. If the customer is someone who does most of their computing in the cloud today, what value is a "personal secure LLM"? Can this person even tell if their local LLM is secure? Doubt it. For the average person, that is best left to "the cloud".