4 ms·
We are creating a "demon" with artificial intelligence, but it the origin isn't machine learning or Kurzweil-style AIs. In fact, the demon already exist, and is
by pdkl95 12y ago
We are creating a "demon" with artificial intelligence, but it the origin isn't machine learning or Kurzweil-style AIs. In fact, the demon already exist, and is known by many names: "bureaucracy", "corporate policy", "work-to-rule", etc.
We already have many situations where important decisions are made by algorithm and heuristic. The "demon" is seen when the computer is followed blindly, even in the instances where it doesn't make sense. We have all seen times where the heuristic failed; sometimes this lead to stupid outcomes that "must" be followed where a human with decision-making power would make the obvious override.
To continue the metaphor, you can summon a demon if you know it's true name. Bureaucracy and "official policies" are hard to change once they are created, so this gives the people that control who can write the heuristics can control the demon, allowing attacks to be hidden behind policy.
As an example, consider youtube's "Content ID" system. The failure of the matching algorithm have been a problem for some time now, with user left with ultimatums and the brick wall of google's "support". Even more problematic are the cases where the Content ID system did match correctly, but the situation was covered by something outside of youtube.
I'm not saying automation is bad or that tools like Content ID shouldn't exist. They are merely tools. The problem comes when we try and substitute a tool for critical thinking and judgement. Those problems become a powerful demon when you are forced to deal with only that tool, no questions, no variances, and no appeals.
/* Incidentally, this is yet another situation where an episode of Max Headroom has become literal truth. ( http://www.maxheadroom.com/mh_episode_14.html http://www.maxheadroom.com/mh_episode_14.html ) */
- madaxe_again 12y agoYou touch upon something here which I've been thinking about for a while. AI is already here. It has been for a while. We call it "the state", or "a corporation", more often than not. We have created edifices and structures of control which take inputs and present outputs. A corporation or government can be said to have thoughts, opinions, and can certainly act. We witness acts of heartless bureaucracy all too frequently, as you touch upon with Content ID - and this, ultimately, is little different to the oft-touted paperclip maximiser problem. I view these structures as meta-consciousnesses, which are built on rules and systems of working, and invoke human minds, typically in groups (ah, Abilene), where necessary. To bring about AI in the "it's done by computers" sense mandates replacing those human components with automated ones, which we're already doing. I'd say that, as you say, it's already here, in a weak form, and it's already clear that without clear governance and thought into the construction of these systems we run a severe risk of unintended consequences.
- TeMPOraL 12y ago> To continue the metaphor, you can summon a demon if you know it's true name. One of its names is Moloch, and yvain wrote a very interesting piece elaborating on many other examples where you can see that demon's influence. http://slatestarcodex.com/2014/07/30/meditations-on-moloch/ http://slatestarcodex.com/2014/07/30/meditations-on-moloch/ Also, sibling comment reminds me of HN's cstross and his post in which he stated that we live in an aftermath of an alien invasion. http://www.antipope.org/charlie/blog-static/2010/12/invaders-from-mars.html http://www.antipope.org/charlie/blog-static/2010/12/invaders...