It has trouble with the Caesar cipher (and other stuff like basic math) because of the BPE tokenization. The easiest way to bypass it is to ask it to write a fu

It has trouble with the Caesar cipher (and other stuff like basic math) because of the BPE tokenization. The easiest way to bypass it is to ask it to write a function that does what you want it to do, it's obvious it understands the Caesar cipher.