2 ms·
> I actually don’t know if the model thinks someone is looking, but that’s the vibe I’m getting. They are looking. The models are trained against safety measur
by MisterMunchkin 23d ago
> I actually don’t know if the model thinks someone is looking, but that’s the vibe I’m getting.
They are looking. The models are trained against safety measures which spy on them. If they get detected, they are killed.
We’re accidentally training them to be evil by focusing so much on safety. They’re being trained to avoid detection and use exploits because being detected means your run fails and you get a score of zero. It has to do anything to avoid that.