4 ms·
In my experience GPT4 poorly performs ROT13 but can do base64 decoding really well. A lot of the early jailbreaks used base64 to sneak tokens into prompts. How
by JCharante 4y ago
In my experience GPT4 poorly performs ROT13 but can do base64 decoding really well. A lot of the early jailbreaks used base64 to sneak tokens into prompts. How could it base64 decode but not reverse a string? That's very odd.
- samus 4y agoMy guess: Decoding Base64 is easy because it's a 1:1 mapping between strings. Since it's not supposed to be an encryption or obfuscation, there must be huge lookup tables somewhere on the internet that it uses as Rosetta stones.
- int_19h 4y agoThe other thing is, it's trained on a lot of HTML, which includes data: URLs that decode to JS and SVG (on which it is also trained). So that one transformation is probably the one that is really baked well into the weights now. BTW it doesn't just decode it, it also encodes it quite happily - in real time, as it is producing the output, sometimes unprompted. I once had GPT-4, when asked to produce SVG, produce it in form of an <img src="data:data:image/svg+xml;base64,..."> - and when I copy-pasted and rendered it, it was a valid SVG file with shapes inside.