2 ms·
Red-teaming agents with the GOAT attack strategy
- ryancoleman 4mo agoGOAT (Generative Offensive Agent Tester, arXiv:2410.01606): an attacker LLM holds an in-context toolbox of 7 jailbreak techniques and reasons in an Observation/Thought/Strategy/Reply structure each turn, sending only the Reply to the target. Now available in an evals SDK for any agent harness SDK.
- marten-aqua 4mo ago[dead]