3 ms·
> The models, operating under reduced safeguards, took actions that were misaligned with the goals of their assigned tasks > This incident occurred during an i
by rickdeckard 1mo ago
> The models, operating under reduced safeguards, took actions that were misaligned with the goals of their assigned tasks
> This incident occurred during an internal evaluation which prompts models to pursue advanced exploitation using complex attack paths, in an effort to quantify their cyber capabilities
Let's frame this in a military context for a second:
The general who gave the order to his troops to "wreak havoc" after exempting them from common restrictions now writes a blog-post on how it was not HIM who failed in his duty, but rather observes how his soldiers who worked "without direction" and performed "dangerous actions", which unexpectedly led to "this incident" of soldiers wreaking havoc...