3 ms·
Erasing gendered pronouns from comments: no, because that's a story I heard from former colleagues who are still there. Arguing maybe girls find geeky stuff bo
by repolfx 7y ago
Erasing gendered pronouns from comments: no, because that's a story I heard from former colleagues who are still there.
Arguing maybe girls find geeky stuff boring: this is what Damore did, but he wrote it much more formally and cited lots of studies. It boiled down to though, "most women find tech boring because they're women". Damore's essay is here: https://firedfortruth.com/2017/08/08/first-blog-post/ https://firedfortruth.com/2017/08/08/first-blog-post/
Manipulating ML models: https://developers.googleblog.com/2018/04/text-embedding-models-contain-bias.html https://developers.googleblog.com/2018/04/text-embedding-mod... with their stated example:
An example of bias in this context is if the incoming message is "Did the engineer finish the project?" and the model scores the response "Yes he did" higher than "Yes she did." These associations are learned from the data used to train the embeddings, and while they reflect the degree to which each gendered response is likely to be the actual response in the training data (and the degree to which there's a gender imbalance in these occupations in the real world), it can be a negative experience for users when the system simply assumes that the engineer is male.
This logic is broken and wouldn't have happened in the old Google. If you're predicting what response the user is most likely to type next, then "Yes he did" is a more useful prediction by any objective measure because most engineers are men. But here, Google AI Research concludes that the most likely prediction would be "a negative experience for users" and sets out to "debias" their models. Debias in this context means to bias the model away from learned reality and towards what liberal intersectionalists want the world to be, in the hope that by subtly manipulating people through AI predictions they can actually bring that world about.
- afiori 7y agoI want to play devil advocate for a moment and defend a wildly optimistic view of what some googlers might intend to do. Already a way to debias a model (I know nothing of ML in specific, it is just an overview) would be to have the model explicitly realize that "engineer" need to be assigned a gender in certain situations. So in this sense the correct answer should be to try and understand whether this engineer is a specific human whose gender you should know so not to make wrong assumptions. Whether this defense applies to this specific case I do not know, my point is that sometimes it is possible to actually partly debias something. The fact that it can be done in the wrong way does not mean it should not be done. The same way there is a nice middle point between corporate anarcho-capitalism and totalitarian regimes.
- repolfx 7y agoI give you points for optimism and arguing in good faith :) Unfortunately the extract I quoted is very clear. They aren't talking about understanding that engineer is a person adjective and thus could refer to an entity of unknown gender, which is a separate subfield of AI to word vectors (it'd entity analysis/knowledge graph). They're talking pure probabilities here: given a sequence of words, what is the most probable following sequence? The model gets the answer correct but Googlers are weak and cannot handle the truth, so in an Orwellian twist they label measured reality "biased" and set out to edit the model to convince it that there's no difference in probability between "Yes he did" and "Yes she did".