4 ms·

We’re building a family AI called Hold My Juice — and last week, our own system mislabeled a recurring meeting between two founders as “childcare.” Calendar: “

by sophiabk 11mo ago

We’re building a family AI called Hold My Juice — and last week, our own system mislabeled a recurring meeting between two founders as “childcare.” Calendar: “Emily / Sophia.” Classification: “childcare.” It was a perfect snapshot of how bias seeps into everyday AI. Most models still assume women = parents, planning = domestic, logistics = mom. We’re designing from the opposite premise: AI that learns each family’s actual rhythm, values, and tone — without default stereotypes.

orochimaaru 11mo ago
AI is trained off Reddit and other social media. If most portrayal in social media of women and girls is (and men for that matter) is biased towards certain activities - that’s what AI is going to spit out. AI doesn’t think. Is this right or wrong is the incorrect question - because AI doesn’t understand bias or morality. It needs to be taught and it’s being taught from heavily biased sources. You should be able to craft prompt and guardrails to not have it do that. Just expecting it to behave that way is naive - if you have ever looked deeper into how AI is trained. The big question is - what solutions exist to train it differently with a large enough corpus of public or private/paid for data. Fwiw - I’m the father of two girls whom I have advised to stay off social media completely because it’s unhealthy. So far they have understood why.
- daveguy 11mo ago
  The problem is crafted prompts and guardrails don't work very well, because these entire networks are trained on average internet garbage. And guess what's getting worse?
  - orochimaaru 11mo ago
    Agreed. The main problem is guys with too much money invested in this bullshit asking everyone to use their snake oil. I think they’re leaning on everyone - even traditional enterprise company boards, startups, etc. to get this going. It’s not organic growth - it’s a PR machine with a trillion $$ behind an experiment.
gwelner 11mo ago
[flagged]

orochimaaru 11mo ago

AI is trained off Reddit and other social media. If most portrayal in social media of women and girls is (and men for that matter) is biased towards certain activities - that’s what AI is going to spit out. AI doesn’t think. Is this right or wrong is the incorrect question - because AI doesn’t understand bias or morality. It needs to be taught and it’s being taught from heavily biased sources. You should be able to craft prompt and guardrails to not have it do that. Just expecting it to behave that way is naive - if you have ever looked deeper into how AI is trained. The big question is - what solutions exist to train it differently with a large enough corpus of public or private/paid for data. Fwiw - I’m the father of two girls whom I have advised to stay off social media completely because it’s unhealthy. So far they have understood why.

daveguy 11mo ago
The problem is crafted prompts and guardrails don't work very well, because these entire networks are trained on average internet garbage. And guess what's getting worse?
- orochimaaru 11mo ago
  Agreed. The main problem is guys with too much money invested in this bullshit asking everyone to use their snake oil. I think they’re leaning on everyone - even traditional enterprise company boards, startups, etc. to get this going. It’s not organic growth - it’s a PR machine with a trillion $$ behind an experiment.

gwelner 11mo ago

[flagged]