I guess I can kind of see that scenario if I squint, but not really. Take the example in the OP. If you're capable of constructing an extremely convoluted promp

I guess I can kind of see that scenario if I squint, but not really. Take the example in the OP. If you're capable of constructing an extremely convoluted prompt to compel the bot to answer questions like how to hack a computer, then you can absolutely find the answer to the question elsewhere, with much greater ease.