5 ms·
Yet people will still tell that worrying about AI taking over is like worrying about overpopulation on Mars, and that this is a problem at least 50 years out.
by onion2k 11y ago
Yet people will still tell that worrying about AI taking over is like worrying about overpopulation on Mars, and that this is a problem at least 50 years out.
As hard as writing AI for a problem space like "how to win at Go" is, it's several orders of magnitude easier than creating a general AI with the self-awareness required to see us as a threat.
- CamperBob2 11y agoThe interesting thing is that this algorithm taught itself to master the game. If you're writing a chess engine, you just "write the AI for the problem space" in a few dozen lines of code, as you put it, and let brute force do the rest. In the case of DeepMind, faced with a game where a traversal approach is numerically impossible, its programmers gave it the ability to improve by playing against itself. That's the difference between a neural net -- which until about an hour ago was a phrase that reliably set off my snake-oil detector -- and a simple tree search. DeepMind just beat a Go master... and nobody can say exactly how it did it. That's a big deal.
- riffraff 11y agoit is a big deal, but it is still very different from general AI, and we are very good at underestimating complexity. Remember that "solve computer vision" was considered a summer project.
- faizshah 11y agoI think it's the same as what happened when the perceptron was the big thing in the 50s/60s. Many made far overreaching conclusions about how the problem of AI had been solved.
- CamperBob2 11y agoRemember that "solve computer vision" was considered a summer project. And they're pretty much there. Have you seen some of the latest results in that field?
- riffraff 11y agoI think you misunderstood, I am referring to the fact that Marvin Minsky in 1966, asked Gerald Sussman to "spend the summer linking a camera to a computer and getting the computer to describe what it saw". We certainly got nearly there, but it was nearly 50 years later, not 3 months. Similarly, something that might look somewhat simple to us right now, might also be a lot more difficult.
- CamperBob2 11y agoI see what you mean -- sorry, I thought you were referring to a Summer of Code project.
- zodiac 11y ago> its programmers gave it the ability to improve by playing against itself Good chess programs definitely use self-play to improve themselves, eg to tune parameters and heuristics.
- CamperBob2 11y agoThey don't invent moves that they weren't explicitly programmed to play, though, do they? People at the top level of play have been beaten by chess programs but not surprised by them, the way the Go professionals have been in this case. DeepBlue didn't teach us anything about chess that we didn't already know.
- pfisch 11y agoIn other words, it could be created in the next 10 to 20 years. We should be taking steps to outlaw black box algorithms right now but I'm sure we won't.
- pgodzin 11y agoHow do you outlaw black box algorithms? What is a black box algorithm? Should we outlaw all calls to libraries we don't have the complete source code to? I can't understand the call to regulate a technology when it is decades (much more that 10-20 years) away from possibly existing in a state that we can't even imagine. Add to that legislators with zero technical literacy. That's essentially advocating for shutting down all research into a technology that can improve millions of lives.
- pfisch 11y agoA black box algorithm is any algorithm that wasn't really written by a human. It isn't about having the source code, it is about utilizing the output of a neural network, which is built up by multiplying a bunch of inputs by weight values and is basically nonsense when you look at it. Basically any algorithm where you are training it with tons of samples and then it creates a logic tree that is not written by a human is a black box algorithm. By the time AI technology gets to the point that we realize we should regulate it we will be too late.
- deleted 11y ago[deleted]
- Houshalter 11y agoThere is a lot of progress being made in AI right now. Hard problems that were expected to take decades, are being beaten regularly. Who is to say how much AI could advance in the next 20-30 years? Do you really believe there's less than a 50% chance strong AI won't be invented in your lifetime?
- onion2k 11y agoThere is a lot of progress being made in AI right now. Hard problems that were expected to take decades, are being beaten regularly. Who is to say how much AI could advance in the next 20-30 years? "We've beaten some hard problems more quickly than expected therefore we'll likely beat other hard problems more quickly than expected" is logical induction. It's equivalent to "I just flipped a coin and got heads. I'll probably get heads again on the next flip." Don't do that. :) Do you really believe there's less than a 50% chance strong AI won't be invented in your lifetime? I don't know. I don't really see the value in speculating.
- pixl97 11y ago>I don't really see the value in speculating. There is all kinds of value in speculating. We do it all the time in things like war games. 'If neighbor $x attacked us, what would happen?, would they win?, what can we do to prevent this?'. Of course this may in your mind hold very little value now, but I promise if and when it occurs you will change your mind quickly on that topic.
- PascalsMugger 11y agoDo you think it's better to propose we won't, and not start preparing for a smarter-than-human intelligence. Or to propose we might, and that we should prepare for it to happen?
- onion2k 11y agoOn the face of it we should definitely have a strategy for dealing with strong AI, but with no knowledge of what strong AI will look like how would we prepare for it? There's ostensibly nothing we can do. Until we make more progress in the field we can't make any preparations other than wild speculation. And that is what I see no value in.