3 ms·
> the type of browser and hardware used to access the internet, the history of online searches and purchases ... once powered by artificial intelligence and ma
by visarga 6y ago
> the type of browser and hardware used to access the internet, the history of online searches and purchases ... once powered by artificial intelligence and machine learning, these alternative data sources are often superior than traditional credit assessment methods, and can advance financial inclusion, by, for example, enabling more credit to informal workers and households and firms in rural areas
Here is one of the most sensitive applications of ML. This one, like face recognition, can directly harm people.
These guys only seem to think about the "superiority" of their method in minimizing lending risk. But the other party into this deal can also have something to lose.
What's the difference between this and the Chinese social scoring system? They want to use private search logs. "Your privacy for a credit score?"
Maybe the model is biased, how do we know? Is there an independent bias assessment process? Is there a way to sue for unfair rating? What are the values of the people working on the training set? Is there a "speak to human" step in the process where you can plead your case? I don't want an automated social discrimination machine.
- nerdponx 6y agoWell said. I would also add that computing such a score requires the same kind of intensive surveillance that many people here on HN (including me) are morally opposed to.
- zajio1am 6y ago> Maybe the model is biased, how do we know? There are multiple mutually incompatible metrics of fairness, being unbiased in one makes it biased in others. See e.g. https://www.chrisstucchio.com/pubs/slides/crunchconf_2018/slides.pdf https://www.chrisstucchio.com/pubs/slides/crunchconf_2018/sl...
- j16sdiz 6y agoChinese social scoring system is much more extensive. It includes jaywalking and speaking evil of the government. It affects internet speed and boarding on trains. Sure the “western countries” are heading that direction, but still have a long way
- MikeUt 6y agoHaving to trade away your privacy for access to financial services (where this is headed) is not OK just because the spying is unbiased. This is a common red herring, like the proliferating surveillance cameras and face recognition - somehow it is always implied the main reason we should worry is the racial bias, while everyone being followed 24/7 by a digital private investigator is a secondary concern.