3 ms·
Anything where an LLM has access to the shell on my personal laptop isn’t “secure” even if you do some hand waving around a split architecture.
by danw1979 9mo ago
Anything where an LLM has access to the shell on my personal laptop isn’t “secure” even if you do some hand waving around a split architecture.
- rvz 9mo agoNothing more like playing Russian roulette with your own machine, hoping that when it needs to delete, move or rename a file, you sure hope it doesn't begin running either (especially do not run with --dangerously-skip-permissions): rm -rf ~/ rm -rf / mv ~/ ./ Or even creating a faulty symbolic link and above your home directory and suggesting to remove it, then it actually removes everything in that folder including your files in the home folder.
- wizardforhire 9mo agoOr it decides to rsync your drive along with keys to who knows where
- yolo3000 9mo agoThis gives me bad memories from when I switched from Windows and somehow created a folder named '~' and then deleted it.
- likium 9mo agoThe tool explicitly has an allow list for commands and block list for sensitive paths[1]. Though it's not enough, stuff like `grep "" .e?v` can still end up sending your sensitive keys to LLM providers. [1]: https://github.com/ygwyg/system/blob/b5adfe526da7470cade61f7aa5ab9bb730019d2b/src/bridge/tools.ts#L94C1-L115C1 https://github.com/ygwyg/system/blob/b5adfe526da7470cade61f7...
- fragmede 9mo agoOf course, only an idiot would do that, and have it go and delete a bunch of shit. I, unfortunately, am that idiot, so if you're also going to be such an idiot, I recommend putting rm behind any sort of wall, no matter how short it should be, eg https://gist.github.com/fragmede/96f35225c29cf8790f10b1668b849af7 https://gist.github.com/fragmede/96f35225c29cf8790f10b1668b8...
- lostmsu 9mo agoGive it a separate user or a VM.
- iAMkenough 9mo agoDon't forget to manage proper permissions for every piece of data your own user account would need acccess to complete the objectives of the agent. Like in the "Play some jazz music" example in the documentation, don't forget to login to the Music app using your own Apple ID on the new user or VM you created.
- fragmede 9mo agospecifically, tart lets you run macOS on macOS fairly well.
- danw1979 9mo agoI’m not sure a user account would contain the potential damage enough for my liking, and isn’t the point of this to enable it to “act like you” on your personal machine ? (which I maintain is a terrible idea).
- lostmsu 9mo agoThere are plenty of services we don't really need strong security boundaries around and any issues are non-critical.