4 ms·
It's awesome that they won. I recently read the paper, and there are a couple of things you need to keep in mind to understand the scope and how general the re
by olau 11y ago
It's awesome that they won.
I recently read the paper, and there are a couple of things you need to keep in mind to understand the scope and how general the result is.
They were using a big cluster to do a brute-force tree search (not brute-force as in exhaustive, but still brute-force as in let's throw lots of hardware at this). According to the paper, this tree search was important in improving the play.
Basically they were using a combination of approaches, like the winners of the Netflix competition a couple of years ago, where each approach in its own was pretty good, but not on the level of Sedol.
The other thing is that this was bootstrapped using a gigantic database of human plays. It's not clear to me that they could have ever achieved what they did without this. Once they trained the neural networks up to the level of an expert player, they could make it play against itself and learn some extra things. But the question is how far this takes you? How much can an AI or a human learn by only playing with itself?
Clearly, it's not yet god-like, since Sedol managed to beat it by a move it wasn't really considering. It's not clear to me how you would improve what they have now, without adding yet another approach, like the Netflix competition where the mixed models got better by the sheer number of them.
- visarga 11y ago> It's not clear to me how you would improve what they have now They could improve the policy network which was based off 100,000 amateur level games. Now they could use AlphaGo self play games which are at the level of 9p as a training set. Another thing they could do is let it run more self play games in order to improve the value net even more.
- TickleSteve 11y agoRecursive improvement.... it plays and learns from itself.
- caligastia 11y agoIt's not yet god-like, but if you were to attach a couple nuclear warheads to the game engine, then at least it would be badass. If the machine feels insulted by a particular move, or just gets tired of the game, bye bye Seoul!