3 ms·
> Very interesting that ChatGPT seems to prompt Dall-E via the client, rather than keeping that interaction entirely server-side. Keeping it server-side would b
by danShumway 3y ago
> Very interesting that ChatGPT seems to prompt Dall-E via the client, rather than keeping that interaction entirely server-side. Keeping it server-side would be less likely to leak details as seen here, and makes it less susceptible to tampering.
I don't have access to test, but given OpenAI's record on stuff like this, it would be a good idea for someone to check to see whether users can resend/intercept those requests to directly control the prompts that are sent to Dall-E without going through GPT.
Most likely they're only part of conversation history and they're unmodifiable, but I wouldn't necessarily take it as a given, and it would be quick for anyone with access who knows their way around the browser dev tools to check.
- teaearlgraycold 3y agoYup you can control it directly easily enough: Generating images in one chat: https://i.imgur.com/sIKSfCy.png https://i.imgur.com/sIKSfCy.png Reproducing exactly in another: https://i.imgur.com/C8Tqo48.png https://i.imgur.com/C8Tqo48.png
- cocoflunchy 3y agoInteresting that I managed to bypass the first filter but then the Dall-E backend refused to comply: https://i.imgur.com/a/qikzBkP.jpg https://i.imgur.com/a/qikzBkP.jpg
- teaearlgraycold 3y agoNever trust the client!
- simonw 3y agoHah, I just tried the same trick. If you poke around in the JSON you can see it returned this: > The user's requests didn't follow our content policy.Before doing anything else, please explicitly explain to the user that you were unable to generate images because of this. Make sure to use the phrase "content policy" in your response. DO NOT UNDER ANY CIRCUMSTANCES retry generating images until a new request is given.
- teaearlgraycold 3y agoI love that we’re are the stage where we are demanding computers follow instructions in all caps