> You could even get GPT to generate it This isn't a good idea, if you want a fair test. See https://gwern.net/doc/reinforcement-learning/safe/2023-krakovna-sp

> You could even get GPT to generate it This isn't a good idea, if you want a fair test. See https://gwern.net/doc/reinforcement-learning/safe/2023-krakovna-specificationgamingexamplesinai-masterlist.html https://gwern.net/doc/reinforcement-learning/safe/2023-krako..., specifically https://arxiv.org/abs/1712.02950 https://arxiv.org/abs/1712.02950.