It sounds like you’re saying that’s a qualitative, insurmountable difference, but I’m not so sure. It reminds me a lot of a young child trying to keep a secret

It sounds like you’re saying that’s a qualitative, insurmountable difference, but I’m not so sure. It reminds me a lot of a young child trying to keep a secret. They focus so much on the importance of the secret that they can’t help giving the whole thing away. I suspect this is just a quantitative difference, the only solution is more training and experience (not some magical “real” experience that is inaccessible to the model), and that it will never be 100% perfect, just as adult humans aren’t perfect - we can all still be tricked by magicians and con artists sometimes.