3 ms·
Earlier this week I posted about an LLM misclassifying my meeting with my co-founder Emily as childcare-related. The HN discussion that followed was more intere
by sophiabk 11mo ago
Earlier this week I posted about an LLM misclassifying my meeting with my co-founder Emily as childcare-related. The HN discussion that followed was more interesting than the original finding.
Initial reactions were skeptical—people thought my prompt or calendar context was biasing the model. Then a commenter ran an A/B test.
Same calendar, same prompt, only changed "Emily / Sophia" to "Bob / John."
Results:
Female names: "likely a playdate, appointment, or activity for children"
Male names: "Meeting/Work - These could be meetings or scheduled appointments"
One initially skeptical commenter: "This is really interesting and way more compelling evidence… I admit I am surprised."