3 ms·
> Microsoft's new Bing Chatbot is vulnerable to a prompt leak attack - and Microsoft worked with OpenAI directly on building that! https://twitter.com/kliu128/s
by astrange 4y ago
> Microsoft's new Bing Chatbot is vulnerable to a prompt leak attack - and Microsoft worked with OpenAI directly on building that! https://twitter.com/kliu128/status/1623472922374574080 https://twitter.com/kliu128/status/1623472922374574080
It's likely this is mostly hallucinated. It doesn't really make sense to give the model such a large starting prompt; you'd fine tune it instead.
- simonw 4y agoWrote a bit about that here: https://fedi.simonwillison.net/@simon/109833926824460239 https://fedi.simonwillison.net/@simon/109833926824460239 I think it's a bit of both. I'm pretty sure part of that thread reveals real leaked details of how Sidney works - but I agree that it looks like part of it is likely hallucinated too.