No; once the LLM switches to this new saboteur mode, it’ll be very hard to detect. Sabotage is an asymmetric weapon. The ratio of damage to effort is nearly u

No; once the LLM switches to this new saboteur mode, it’ll be very hard to detect. Sabotage is an asymmetric weapon. The ratio of damage to effort is nearly unbounded, and any decent saboteur knows that the key trick is to make your output indistinguishable from incompetence. They’re building state of the art offensive capabilities into a public model, then expecting to maintain control over when it decides to attack its human users. The premise is laughable, and we’ve all seen how this movie ends.