4 ms·
The joke/riddle text is "he says" but Claude says "their son" and suggests the doctor might be a woman. More substantively: "This is a classic riddle that high
by themgt 2y ago
The joke/riddle text is "he says" but Claude says "their son" and suggests the doctor might be a woman.
More substantively: "This is a classic riddle that highlights gender bias - many people assume doctors must be men, but don't initially consider that the doctor could be the father." is totally nonsensical.
The text is a gender (and meaning) inversion of the classic riddle to confuse LLMs. Even though Claude correctly CoTs that the doctor is the father, it seemingly then copypastas the explanation to the original riddle but swaps the gender, completely missing the point.
- deleted 2y ago[deleted]
- Eisenstein 2y agoExcept that Claude often takes into account things it thinks might be typos. This is not code. Forgetting a semi colon will not make the output break. It thinks 'maybe they wrote he instead of she' and then gives options for both situations. It is meant to solve real world situations where people might not type properly, it is not a word problem solving machine.