4 ms·
You cannot make decisions based purely on facts and data. You also need goals, values, preferences or what you prefer to call it.
by TorKlingberg 9y ago
You cannot make decisions based purely on facts and data. You also need goals, values, preferences or what you prefer to call it.
- dogruck 9y agoI agree with you. I just don't know how it will work. Suppose we have a program that approves or denies loan applications. We input the acceptable default rate, and it makes the approval decisions. Then, we notice that the software disproportionately denies applications from a few demographics. What's the right reaction? Or, what if the software makes hiring decisions, where the objective function is "hire people that will, in aggregate, maximize the corporate stock price."
- alvis 9y agoIn fact, it is a new problem in fin tech. While ML can mimic human decision quite accurately nowadays, machines remain largely incapable to handle new information. Now suppose again we have a machine that rate load applications. In the past when you write your occupation as AI scientist, probably it won't make a difference than others. However, same occupation in the past few years, even you haven't got the default data to retrain the machine, a human would know the risk is significantly lesser than the majority. The problem? While we think the machine is at inferring future outcome, it is not in some important cases which we are largely unaware of.