4 ms·
Sandbox alone wouldn't have helped here though. The failure (deletion of files) happened inside the project folder. What it really needs is a (preferably deter
by daxfohl 1y ago
Sandbox alone wouldn't have helped here though. The failure (deletion of files) happened inside the project folder.
What it really needs is a (preferably deterministic) way to revert any sequence of changes and get you back to the original state. And big warning messages before it can do anything that doesn't have an associated rollback command.
Granted, that's not entirely sufficient either; rolling back the creation of a security hole doesn't undo whatever information was leaked while it was open.
I kind of wouldn't be surprised if safeguards for this sort of stuff ends up being a larger industry than AI agents themselves. It really requires a whole rethink of how systems are designed, but without it, the value we can get from AI agents will be severely limited.