4 ms·

This is pretty egregious. For those of us working on machine learning, does anybody know of datasets that have decent representation of different colors of ski

This is pretty egregious. For those of us working on machine learning, does anybody know of datasets that have decent representation of different colors of skin. That seems like the cause here and thinking back, my datasets aren't the most diverse out there.

TazeTSchnitzel 6y ago
ML inherits the biases of the data it is trained on. If you want “unbiased” ML models, you must train them on data that is carefully constructed to avoid the biases deemed undesirable.
- marvindanig 6y ago
  The way HN’s topic floatation algorithm is behaving on this thread right now makes me suspicious about this forum as well. I am not sure if it’s an ML model issue here or just some quiet downvotes by the you-know-who.
  - Lammy 6y ago
    I don’t know “who”. Please tell me. I’m sorry to sound flippant but I mean this sincerely since I’ve never observed any correlation between downvote-used-as-disagree and any particular beliefs.
    - marvindanig 6y ago
      > "never observed any correlation between downvote-used-as-disagree and any particular beliefs." Quick question: Why would anyone downvote or upvote anything if they didn't believe in something? Your line of query isn't flippant, I agree. It's a reaction to a privilege at worst or a denial of why this thread was downvoted by the you-do-know-who in the first place. Edit: I wasn't certain earlier, but now thanks for proving the point.
      - Lammy 6y ago
        I 'vouch'ed for your comment, for what it's worth. I still don't know 'who'.
        marvindanig 6y ago
        Sure. Well, maybe you should ask this question to the mods then. Just like you I'm all for outing the 'who' here.
- GuB-42 6y ago
  I remember I took an introduction class in machine learning when I was a student. I was surprised how important bias removal was. Preparing the dataset was more than half of the work. And the class was more about statistics than anything else. It wasn't about racial bias, ethics, or anything like that. More like if you feed too many "5" in your handwriting recognition algorithm, it will will start seeing 5 everywhere.
  - disgruntledphd2 6y ago
    Preparing the dataset is 99.9% of pretty much all ML and data science. Just like all software engineering is maintenance, all DS is data cleaning.
Lammy 6y ago
No it isn’t. Look at the massive empty space this person had to construct between the two content areas of those tall images to get it to behave like this. No reasonable person would ever create something like that accidentally in a way that would create this behavior.
svrb 6y ago
The dataset linked from this thread on Twitter may serve your needs too?: https://twitter.com/vinayprabhu/status/1307497736191635458?s=19 https://twitter.com/vinayprabhu/status/1307497736191635458?s...

TazeTSchnitzel 6y ago

ML inherits the biases of the data it is trained on. If you want “unbiased” ML models, you must train them on data that is carefully constructed to avoid the biases deemed undesirable.

marvindanig 6y ago
The way HN’s topic floatation algorithm is behaving on this thread right now makes me suspicious about this forum as well. I am not sure if it’s an ML model issue here or just some quiet downvotes by the you-know-who.
- Lammy 6y ago
  I don’t know “who”. Please tell me. I’m sorry to sound flippant but I mean this sincerely since I’ve never observed any correlation between downvote-used-as-disagree and any particular beliefs.
  - marvindanig 6y ago
    > "never observed any correlation between downvote-used-as-disagree and any particular beliefs." Quick question: Why would anyone downvote or upvote anything if they didn't believe in something? Your line of query isn't flippant, I agree. It's a reaction to a privilege at worst or a denial of why this thread was downvoted by the you-do-know-who in the first place. Edit: I wasn't certain earlier, but now thanks for proving the point.
    - Lammy 6y ago
      I 'vouch'ed for your comment, for what it's worth. I still don't know 'who'.
      - marvindanig 6y ago
        Sure. Well, maybe you should ask this question to the mods then. Just like you I'm all for outing the 'who' here.
GuB-42 6y ago
I remember I took an introduction class in machine learning when I was a student. I was surprised how important bias removal was. Preparing the dataset was more than half of the work. And the class was more about statistics than anything else. It wasn't about racial bias, ethics, or anything like that. More like if you feed too many "5" in your handwriting recognition algorithm, it will will start seeing 5 everywhere.
- disgruntledphd2 6y ago
  Preparing the dataset is 99.9% of pretty much all ML and data science. Just like all software engineering is maintenance, all DS is data cleaning.

Lammy 6y ago

No it isn’t. Look at the massive empty space this person had to construct between the two content areas of those tall images to get it to behave like this. No reasonable person would ever create something like that accidentally in a way that would create this behavior.

svrb 6y ago

The dataset linked from this thread on Twitter may serve your needs too?: https://twitter.com/vinayprabhu/status/1307497736191635458?s=19 https://twitter.com/vinayprabhu/status/1307497736191635458?s...