4 ms·
AI Evangelists Scare Me
- ftxbro 4y ago> "If AI companies are allowed to market AI systems that are essentially black boxes, they could become the ultimate ends-justify-the-means devices. Before too long, we will not delegate decisions to AI systems because they perform better. Rather, we will delegate decisions to AI systems because they can get away with everything that we can’t. You’ve heard of money laundering? This is human-behavior laundering. At last—plausible deniability for everything." This has already fully happened under the name of 'algorithms.' Not necessarily like classical computer science algorithms but like 'the algorithm rejected your loan' or 'the algorithm said your insurance rate is $517 per month' or 'the algorithm declines your registration application'.
- gavinhoward 4y agoVery true. And AI will only accelerate the trend.
- shubb 4y agoI also wonder if an AI evaluator would score AI generated with higher than human generated work if the AI was trained in the same input data. So for instance I'm using an AI to evaluate college application essays, trained on a big database of them someone is selling. The grading AI will grade essays similar to the best rated training essays high, and the essay generating AI that naughty applicant is using will generate an essay as similar as possible to the training data in the ways an AI cares about (word frequencies?). However a human applicant writing an equally good essay will get a lower grade from the AI because it is looking for similarity not "goodness" exactly. This creates a situation where you need to pay for the most popular AI in order to win contracts, get jobs, planning permission, grants... it's a network effect like social media.
- gavinhoward 4y agoUpvote, even though you found yet another way to scare me!