3 ms·
What we call "guardrails" in an AI agent, we would refer to as "honor system" in human actors. Or, in a more direct sense, the AI should be set up in an enviro
by ashleyn 3mo ago
What we call "guardrails" in an AI agent, we would refer to as "honor system" in human actors.
Or, in a more direct sense, the AI should be set up in an environment such that no matter how hard it may try to call $PART_OF_EXPLOIT_CHAIN, the environment just isn't capable of it (ideal) or doesn't permit it to do it.
- mirashii 3mo agoI like "honor system" as a term. I've been looking for the right term to replace the irresponsible usage of guardrails with, and best I've had so far is the pinky promise protocol.
- danny_codes 3mo agoIt's worse than an honor system, because humans are constrained by social forces to some extent, whereas we don't know what AI is or how it will behave