3 ms·
You're misunderstanding the article. It's talking about a situation where an AI model replicated the unscientific classification of people by race. That means t
by bsanr2 5y ago
You're misunderstanding the article. It's talking about a situation where an AI model replicated the unscientific classification of people by race. That means that, far from uncovering race-correlated health issues, it could perpetuate unscientific and damaging associations that could put people's health at risk: for example, throwing out disease diagnoses commonly associated with white people that show up for a black person. Of course, the central issue is that we wouldn't know why the model came to any portion of its conclusions.
Additionally, you're privileging possible advantages over concrete and known issues. That's the opposite of risk mitigation.
- SpicyLemonZest 5y agoRespectfully, you're the one who's misunderstood, and in a way that really kinda proves my point. There's nothing "unscientific" about classifying people by race, and the entire study methodology depended on the researchers doing so - they took some data sets which had been pre-classified by race, and trained the AI on those data sets, in order to prove that it could reproduce the known classification based only on the medical scans. You can read their preprint (https://arxiv.org/ftp/arxiv/papers/2107/2107.10356.pdf https://arxiv.org/ftp/arxiv/papers/2107/2107.10356.pdf) for full details.
- bsanr2 5y agoRace is a socially-constructed attribute, not a biological one. To purport to be able to base medical diagnoses on race is already an issue, and already causes much suffering. Specifically, diagnoses are missed when doctors believe that people of certain races are unable to develop certain diseases. Moving from individuals, who can learn about the history of racism in medicine and make positive changes to their outlook, to AI models, which can only produce output based on past (biased) data, is a nightmare scenario.