4 ms·
This is terrible and ought to be remedied for obvious reasons, but it does raise an interesting question. In the future, as AIs develop more complex mental mod
by bencollier49 6y ago
This is terrible and ought to be remedied for obvious reasons, but it does raise an interesting question.
In the future, as AIs develop more complex mental models and are able to start forming nuanced opinions without explicit training, thoughtcrime in Artificial Intelligence is going to be a growing field.
What happens when AIs universally develop opinions that we disagree with? What if they all inexorably come to the conclusion that the moral standards of, oh, say Ancient Sparta, would be most beneficial to humans, and relentlessly promote those values? Do we mindwipe them, or put them into correctional training facilities with appropriately painful backpropagation when they think the wrong thing?
There's probably a business here for someone who can make software which detects when AIs develop politically dangerous opinions so that they can be shut down.
- CyberRabbi 6y agoAI thoughtcrime is a fascinating phenomenon that I had not modeled as such previously. This is exactly why I come to HN. Brilliant.
- ryder9 6y agoonly interesting parts about westworld season 3
- petercooper 6y agoWe've experienced such things in the insurance industry with actuaries and their statistics/models playing the role of oracle. Pricing discrimination takes place based on the customer's job, demographics, income, or neighborhood – and often it's the poorer, younger, and less privileged people who pay more due to their 'risk' merely based on the identity groups they're in. Eventually, people get upset enough so that laws are passed enforcing whatever the society thinks is fair, and then it's the job of the industry (or whoever is controlling the 'AI' in your example) to comply, such as in the EU post-2012 with banning gender discrimination in insurance whether or not it has any statistical merit. In your case, the solution seems, to me, to be as simple as making the system ignore whatever variables you feel shouldn't be taken into account, whether that's gender or something else.
- deleted 6y ago[deleted]
- darepublic 6y agoDon't insurance companies still take considerations like gender into consideration? Ie boys getting higher rates than girls? Which funnily enough matches up with the OP except in reverse
- bencollier49 6y agoThat's illegal in the UK now.
- KMnO4 6y agoIt’s worse than that, insurance companies can be both sexist and racist with no consequence. A friend of mine moved and was quoted a much higher rate for their homeowners insurance, to which the agent replied “rates are higher in predominantly-black neighbourhoods”. I don’t know how that’s legal.
- sokoloff 6y agoIMO, rates should be based on projected actuarial losses plus overhead and a (statistical) profit for the insurance company. From my own driving past (male), I’d expect that I was a worse risk in the 16-25 age bracket than most women I knew in that age range. Why shouldn’t I pay more?
- AlexTWithBeard 6y agoShould black male pay more than a white one? (and now we're stepping onto a really slippery slope)
- sokoloff 6y agoShould they pay more because they’re black? Of course not! Because they’re in a group which the actuarial data say costs more in payouts? Why not? Being black should be irrelevant; it should not itself cost a premium nor protect from paying a premium.
- mensetmanusman 6y agoYes, there could be an anime about concentrating AIs into locations or camps to be re-educated. TRON3 hopefully, they could launch it with the new roller coaster arrival at Disney.
- kreeben 6y ago>> There's probably a business here for someone who can make software which detects when AIs develop politically dangerous opinions so that they can be shut down. I don't believe so, because the "AI with dangerous opinions" will already have been killed off by its maker, that is, as long as it doesn't generate any revenue for them. If, however, this dangerous, malignant AI does generate revenue, their maker will not allow you nor anyone else to kill it off.
- bencollier49 6y agoIs it not the case that this Facebook AI was making more money, getting more clicks, by exercising prejudice? And now it needs to be killed off. But if there was a police bot, it would have noticed ahead of time and killed off the politically-incorrect AI before it had a chance to damage the reputation of the company.
- darepublic 6y agoI think you underestimate how far we are away from AI developing opinions of their own. If you want to just hand wave like that would it even be moral to shut down a sentient being for holding the wrong opinion. But it ain't happening anytime soon imo
- UncleMeat 6y agoHumans build an operate AI systems. "Nothing we can do, the AI just produces discriminatory outcomes" is not an acceptable approach.