3 ms·
Here's some related challenge I'm facing. Maybe someone can help me: I also managed to make AI critique itself and that improved code generation a ton. For a
by hu3 2y ago
Here's some related challenge I'm facing. Maybe someone can help me:
I also managed to make AI critique itself and that improved code generation a ton.
For a TypeScript backend project that runs with Bun, I tell AI to also generate and run unit tests after every code change suggested by AI.
How do you solve the risk of AI writting and executing unit tests with something like `rm -rf /` and wiping your files?
Docker works but I like to keep things simple.
Deno supports revoking file access but I'd like to keep using Bun.
- zactato 2y agoEither you trust AI or you don't? If you don't trust it then you need to review what it's writing. Docker seems like a pretty low complexity way to create an isolated environment to run automation.
- derwiki 2y agoManually approve every terminal command it wants to run instead of vibe mode. Tbh I think an rm -rf scenario is exceedingly unlikely.
- ivape 2y agoa) You should only do this in a sandbox b) You can have the AI run a "firewall" prompt on the final output. So your final output should go through a "You are a firewall that checks for dangerous terminal commands such as <enumerate list of dangerous commands>. If you spot dangerous commands, reform the command so that it is not dangerous"
- nowittyusername 2y agoNo way around it, got to sandbox the whole thing no matter what.
- small_scombrus 2y ago> How do you solve the risk of AI writting and executing unit tests with something like `rm -rf /` and wiping your files? The same way you stop any person or program or third party from doing something dumb or nefarious with your files. Don't give them any access to important files.