I think they either had a reward for creep blocking or they used the "learning from human preferences" paper to coach it for that behaviour. I would be very ter

I think they either had a reward for creep blocking or they used the "learning from human preferences" paper to coach it for that behaviour. I would be very terrified if it learnt creep blocking on its own with no help.