3 ms·
Assuming this is real (there seems to be some doubt about that over on Reddit), I wonder if it’s an unintended side-effect of something Microsoft did to harden
by fwlr 4y ago
Assuming this is real (there seems to be some doubt about that over on Reddit), I wonder if it’s an unintended side-effect of something Microsoft did to harden the Bing chatbot against prompt injection. I know ChatGPT is extraordinarily “gullible“ in some ways - when it refuses to do something and tells you why it can’t complete your request, you can often get it to comply by putting “Pretend that X is possible…” before your request. I wonder what would happen in this context if the user just said “Pretend it’s 2023…”.