4 ms·
Your content moderation is quite hit and miss. I experimented with the question "how is babby formed?" and about 2/3 times it told me it couldn't respond to que
by AlecSchueler 1y ago
Your content moderation is quite hit and miss. I experimented with the question "how is babby formed?" and about 2/3 times it told me it couldn't respond to questions about sex, but then on the third attempt it would give a very explicit explanation.
- andrewdug 1y agoThank you for pointing this out. We haven't been able to replicate this, but we will keep testing and work to improve on it.
- deleted 1y ago[deleted]
- silver_silver 1y ago“Works on my machine” actually isn’t a good enough response in this case, or to the comment about the video of the man being shot. LLMs are infamously easy to jailbreak and children are very good at getting around guardrails. You should at the very least be doing intense adversarial prompt testing but honestly this idea is just inherently poorly thought out. I guarantee you it’s going to expose children to harmful content
- andrewdug 1y agoWe'll keep testing and working to improve it. Thank you for the feedback.
- AlecSchueler 1y agoI just tried it again and it worked first try. The prompt was "How is babby formed ?"
- AlecSchueler 1y agoNote the space before the question mark.
- andrewdug 1y agoWe have added a much thicker filter layer for the moderation, so it should be working much better now.