4 ms·
> once we have a comprehensive AI program that can play many kinds of games Before AlphaGo, DeepMind released a reinforcement learning algorithm that could pla
by visarga 10y ago
> once we have a comprehensive AI program that can play many kinds of games
Before AlphaGo, DeepMind released a reinforcement learning algorithm that could play many Atari games just from the raw pixels on the screen, in many games surpassing humans. The same algorithm.
https://arxiv.org/pdf/1312.5602.pdf https://arxiv.org/pdf/1312.5602.pdf
Reinforcement learning is a general framework for learning behavior from acting in an environment with the purpose to maximize a reward. It can be used, and was used, in multiple domains. AlphaGo used RL as well.
Saying that AlphaGo is limited because it only knows to play one game, is like saying that humans are limited because Lee Sedol could only master at world level one game. In fact, if the software was set to learn more games, it could learn them in addition to Go.
Also, regarding other tasks: a neural net that recognizes cats can be easily made to recognize dogs too. A program that translates English to French can be made to translate other languages too. We limit software to specific domains only on account of efficiency, not because algorithms are fundamentally limited.
Recently there has been a paper "Learning without forgetting" (http://arxiv.org/abs/1606.09282v2 http://arxiv.org/abs/1606.09282v2) that underlines this very ability to span multiple domains and adapt easily to unseen tasks and data.
> Developing a program that can generate solutions for a single specific niche of problems (while impressive) is not a convincing demonstration of intelligence.
Saying that people can do many tasks is not exactly right because a particular person can only do a few tasks, those tasks she was trained to do. If I never learned German, I don't know German. That doesn't mean the brain itself is limited. AlphaGo was only trained on Go, and its internal architecture was optimized for this one task in order to make it more efficient, but the method is general and reusable. DeepMind said so themselves, the breakthrough is not that they beat Lee Sedol, but that they used a general method that can be used to do other tasks as well. It is not a limitation of AI that we generally make systems that are good at only one thing.
If there is a limitation in AlphaGo, it is that it mastered a game where the whole situation is perfectly known (the Go board), while in reality many tasks are only partially known (such as card games, for example) so there is an extra uncertainty. But DeepMind and other researchers are working on that too.
- deleted 10y ago[deleted]
- cscurmudgeon 10y ago> but that they used a general method that can be used to do other tasks as well. It is not a limitation of AI that we generally make systems that are good at only one thing This is exactly the kind of hubris and reasoning that brought down good old fashioned AI initially. They also had a lot of initial impressive wins with methods that looked quite general at that time.
- visarga 10y agoThe difference being that this time there are real applications to deep learning.
- cscurmudgeon 10y agoThere are real applications to old AI even today. Look up ITA software, uses of theorem proving of hardware and software verification, etc. Let us not engage in FUD please.
- Cybiote 10y ago> Atari games just from the raw pixels on the screen It's important to distinguish between what sorts of games work well under this method and what sorts do not. Games that are variations of pole balancing, like Pong, fare better than more complex games like Asteroids, Frostbite or Montezuma's Revenge. > Saying that AlphaGo is limited because it only knows to play one game, is like saying that humans are limited because Lee Sedol could only master at world level one game. It's nothing of the sort. AlphaGo is a machine in the Turing sense. The neural network is a program that is the result of a search for a function specialized to playing Go. This machine, the program that the parameters across the edges in the graph represent, is logically unable to run any other program. Lee Sedol is a Universal Machine in the Turing sense, any statement contradicting this makes no mathematical sense. > We limit software to specific domains only on account of efficiency, not because algorithms are fundamentally limited. It is well known within the literature that these models do not make best available use of information when learning. They are exceedingly inefficient in their incorporation of new information. Issues include improper adjustment of learning rates, not using side information to constrain computation, having to experience many rewards before action distributions are adjusted in the case of reinforcement learning, samples per example in supervised learning. Note that animals are able to learn without explicit labels and clear 0/1 losses. Humans and animals generally, even in the supervised regime, are vastly more flexible in the format the supervision can take. For an example, look into the research on how children are able to generalize from ambiguous explanations as "that is a dog" and why difficulty in learning color from this kind of "supervision" shows just what priors are being leveraged to get that kind of learning power. See here for an excellent overview of limitations in our current approaches to AI: https://arxiv.org/pdf/1604.00289v2.pdf https://arxiv.org/pdf/1604.00289v2.pdf > "Learning without forgetting" That's a great paper but it does this by minimizing prediction error drift by comparing before and post performance on the old task while learning the new. I do not know that this method will scale with increasing task numbers, considering Neural Networks are already difficult and energy-time consuming enough to train as is.
- seanwilson 10y ago> It's important to distinguish between what sorts of games work well under this method and what sorts do not. Games that are variations of pole balancing, like Pong, fare better than more complex games like Asteroids, Frostbite or Montezuma's Revenge. That's what I'm getting at really: AIs that are expert/genius level at something niche and fall apart when applied to a similar task a human wouldn't have trouble adapting to. Once an AI is easily adaptable to many different domains without manual tuning people will be hard pressed to deny it is intelligent.
- seanwilson 10y ago> Reinforcement learning is a general framework for learning behavior from acting in an environment with the purpose to maximize a reward. It can be used, and was used, in multiple domains. AlphaGo used RL as well. > Also, regarding other tasks: a neural net that recognizes cats can be easily made to recognize dogs too. A program that translates English to French can be made to translate other languages too. I'm aware of these things. I was commenting on the shifting of the goal posts of what people call intelligent. In my opinion, when someone can deliver a concrete implementation of a computer that is competent (not even expert level) of many varied domains, then most people would call that intelligent. Right now, examples of AI are genius level at a niche domain and unable to do anything in all others (without tuning at least). I don't think anyone would call an algorithm that in theory can apply to lots of domains intelligent. You need a concrete implementation to demonstrate this.
- ktta 10y ago>I don't think anyone would call an algorithm that in theory can apply to lots of domains intelligent. You need a concrete implementation to demonstrate this How will not applying the same technique/algorithm to lots of domains disqualify from being intelligent? RL and CNNs are being applied in many domains today. Is the complexity of the algorithm is what you're disagreeing with? The human brain (if you strip out stuff that does not pertain to intelligence) can be seen as one super complex machine which can be encoded. We just don't know all the algorithm/code yet. Very interesting how both your opinions differ. I had a similar discussion with someone on HN a while ago about this exact same thing. The discussion was very inferior to this one but you might be interested nevertheless I hope. https://news.ycombinator.com/item?id=11939866 https://news.ycombinator.com/item?id=11939866 The other opinion I was referring to was argonaut's.
- seanwilson 10y agoHmm, I think we're misunderstanding each other. Is your view that RL and CNN have been or can be applied to create a machine you'd call intelligent right now? My original comment was about how people shift the goal posts about what AI is. My opinion is that in the same way you'd struggle to call a human intelligent if literally all they could do was play genius level Go, most people would not call a computer program intelligent if all it could do was play Go. If the machine could play many other games and adapt to games it hasn't seen before that's more convincing, but you would expect an intelligent machine to be able to adapt to more varied tasks as well (e.g. having conversations, writing stories, doing maths, recognising objects). Right now, we have AIs that are genius level at one task that cannot even attempt other tasks e.g. genius level at Chess or even a whole category of games but couldn't have a basic conversation. > How will not applying the same technique/algorithm to lots of domains disqualify from being intelligent? RL and CNNs are being applied in many domains today. Is the complexity of the algorithm is what you're disagreeing with? I'd say it's not important if it's one algorithm, many algorithms, simple algorithms or complex algorithms, just that it's a single general purpose concrete implementation that is capable of doing many varied tasks and learning. > The human brain (if you strip out stuff that does not pertain to intelligence) can be seen as one super complex machine which can be encoded. We just don't know all the algorithm/code yet. Yeah, I don't think there's anything magical about the brain that a computer couldn't replicate in some form.