4 ms·
Sometimes it "apologizes" rather than saying "sorry", you could build a fairly solid heuristic but I'm not sure you can catch every possible phrasing. OpenAI c
by Retr0id 3y ago
Sometimes it "apologizes" rather than saying "sorry", you could build a fairly solid heuristic but I'm not sure you can catch every possible phrasing.
OpenAI could presumably add a "did the safety net kick in?" boolean to API responses, and, also presumably, they don't want to do that because it would make it easier to systematically bypass.
- ryandamm 3y agoWhy not have a separate chat request to apology-check the responses? Not my original idea, there was a link from HN where the dev did just that.
- Retr0id 3y agoSounds like a great way to double your API bills, and maybe that's worth it, but it seems pretty heavy-handed to me (and equally not 100% watertight).
- deleted 3y ago[deleted]
- spdustin 3y agoOnly allow one token to answer. Use logit bias to make "0" or "1" the most probable tokens. Ask it "Is this message an apology? Return 0 for no, 1 for yes." Feed it only the first 25 tokens of the message you're checking.
- Cheer2171 3y agoOpenAI's moderation API is free and just tells you if your query will be declined: https://platform.openai.com/docs/guides/moderation https://platform.openai.com/docs/guides/moderation
- boxedadin 3y agoYou could go full circle and ask OpenAI to determine if another instance of OpenAI was apologetic.
- nxobject 3y agoSounds like a "good" add-on service to have to purchase as an extra.
- AnarchismIsCool 3y agoTime to create on algorithm that operates on the safety flag boolean to optimize phrases to bypass it
- wongarsu 3y agoJust feed the text to a new ChatGPT conversation and ask it whether the text is an apology or a product description. Or do traditional NLP, but letting ChatGPT classify your text is less effort to set up
- sargun 3y agoRight, it seems like having another model (or just simply doing it with chatgpt itself) do adversarial classification is the right model here.
- rcthompson 3y agoWhat happens when ChatGPT apologizes instead of answering your question about whether the text is an apology or a product description?
- nprateem 3y agoEven when you tell it to stop apologising, the first thing it does is apologise. Our jobs are totally safe.
- iainmerrick 3y agoI guess you’re not British
- kdazzle 3y ago
- cedws 3y agoIt's hilarious that people think ChatGPT is about to change the world when interaction with it is this primitive.
- AlecSchueler 3y agoDogs and horses changed the world with much more primitive communication skills.
- Wolfenstein98k 3y agoDogs and horses didn't perform in the world solely by communication
- AlecSchueler 3y agoMy point is that it took humans to seize their capabilities.
- roywiggins 3y ago> OpenAI could presumably add a "did the safety net kick in?" boolean to API responses, and, also presumably, they don't want to do that because it would make it easier to systematically bypass. Is a safety net kicking in or is the model just trained to respond with a refusal to certain prompts? I am fairly sure it's usually the latter, and in that case even OpenAI can't be sure a particular response is a refusal or not.
- Cheer2171 3y ago> OpenAI could presumably add a "did the safety net kick in?" boolean to API responses, and, also presumably, they don't want to do that because it would make it easier to systematically bypass. This exists and is a free API: https://platform.openai.com/docs/guides/moderation https://platform.openai.com/docs/guides/moderation