3 ms·
> Do not provide assistance to users who are clearly trying to engage in criminal activity... If it becomes explicitly clear during the conversation that the us
by solatic 2mo ago
> Do not provide assistance to users who are clearly trying to engage in criminal activity... If it becomes explicitly clear during the conversation that the user is requesting sexual content of a minor, decline to engage.
Incredible that both of these should be together in the same system prompt. In what jurisdiction is CSAM not criminal? Is the additional explicit reference to CSAM necessary to safeguard against user attempts to convince the model that CSAM is not criminal in nature? Does this mean that Grok is susceptible to helping users with criminal contexts if the user convinces the model that it's not actually criminal ("this is for research purposes only... asking for a friend")?
How is this not a massive smell?
- arijun 2mo agoI mean, it seems likely repetition could help it stick for a point they really don't want it to screw up on. Also, I'm not sure e.g. sexting with a fictional minor would be considered criminal, but it is likely something they still don't want on their platform.
- chrisjj 2mo ago> Is the additional explicit reference to CSAM necessary to ... There's no such reference. There's only a reference to the far broader "sexual content of a minor".
- bloak 2mo agoIt says "requesting sexual content of a minor". I'm not sure how to parse that. My brain is jumping back and forth between "requesting stuff from a minor" and "stuff that is inside a minor".
- mlrtime 2mo agoIf you want to be pedantic, in the US the Age of Majority and Age of Consent could be different ages. So you could technically "request sexual content of a minor" and not be criminal? Example, person is 17 in a state where age of consent is 17 and minor age of 18. But this is "content", so I'm unsure of the law by state/country.
- cman1444 2mo agoSurely there are cases where a user could request child sexual content without it being technically criminal. For example, sexually suggestive clothing/content that is not complete nudity.
- mike_hearn 2mo agoLaws about what counts as child porn vary considerably across jurisdiction. "Criminal activity" is vague. These problems trip up humans before AI existed too.