5 ms·
I filed a bug on BugCrowd with this issue, from the api, but it was dismissed. if you ask it to “rewrite” as the system message and no user message, it rewrites
by sturza 3y ago
I filed a bug on BugCrowd with this issue, from the api, but it was dismissed. if you ask it to “rewrite” as the system message and no user message, it rewrites some random user’s message.
Edit: if i remember correctly it was the 16k gpt3.5 turbo model
- wodenokoto 3y agoHow do you know its a random users message and not a generated user message based on the training data?
- sturza 3y agoAs proof, it gave me multiple rewrite answers saying that what i asked(random user’s ask) was not meeting their guidelines/safety and cannot answer.
- wildrhythms 3y agoI don't understand how this is proof. OpenAI can easily have guardrails that prevent queries asking for other users information.
- sturza 3y agoWell, it's the best i got. I would expect it to hallucinate, but i would not expect it to hallucinate restricted content and then tell itself it's forbidden.