3 ms·
Absolutely. It should simply not have permissions to delete your production database, can’t rely on prompting alone for that kind of safety. These are still st
by ricardobeat 4mo ago
Absolutely. It should simply
not have permissions to delete your production database, can’t rely on prompting alone for that kind of safety.
These are still stochastic machines, guardrails must be inserted at the system level.
They are getting better every day about managing their own guardrails, so we will get there eventually.
- overgard 4mo agoI entirely agree, although I think this is counter to the narrative that we should just let the agent do everything that the labs want to sell. There's a really major problem with the concept of human-in-the-loop though, which is just that humans are not built for that that kind of work. It's like all those tests against the TSA where they manage to sneak something through that should have been caught. But the problem is, a TSA agent sees probably like 1000 things they can ignore to the 1 thing they need to look at, and it's easy to just start rubber stamping things.