8 ms·
>Deepmind hasn't shown anything breathtaking since their Alpha Go zero They went on to make AlphaZero, a generalised version that could learn chess, shogi or a
by tim333 8y ago
>Deepmind hasn't shown anything breathtaking since their Alpha Go zero
They went on to make AlphaZero, a generalised version that could learn chess, shogi or any similar game. The chess version beat a leading conventional chess program 28 wins, 0 losses, and 72 draws.
That seemed impressive to me.
Also they used loads of compute during the training but not so much during play.(5000 TPUs, 4TPUs).
Also it got better than humans in those games from scratch in about 4 hours whereas humans have had 2000 years to study them so you can forgive it some resource usage.
- pleasecalllater 8y ago> The chess version beat a leading conventional chess program 28 wins, 0 losses, and 72 draws. In a not equal fight, and the results are still not published. I'm not claiming that AlphaZero wouldn't win, but that test was pure garbage.
- tim333 8y agoThe results were published - https://arxiv.org/abs/1712.01815 https://arxiv.org/abs/1712.01815 I agree AlphaZero had fancier hardware and so it wasn't really a fair fight.
- red75prime 8y agoStockfish is not designed to scale to supercomputing clusters or TPUs, Alpha Zero wasn't designed to account for how long it takes to make a move, fair fight was hard to arrange.
- pleasecalllater 8y agoNo, these are not full results. There are just 10 example games published. Where is the rest?
- salvar 8y agoHow was it not equal?
- tim333 8y agoThere's discussion here https://chess.stackexchange.com/questions/19366/hardware-used-in-alphazero-vs-stockfish-match https://chess.stackexchange.com/questions/19366/hardware-use... AlphaZero's hardware was faster and Stockfish had a year old version with non optimum settings. It was still an impressive win but it would be interesting to do it again with a more level playing field.
- felippee 8y agoIt's not like humanity really needs another chess playing program 20 years after IBM solved that problem (but now utilizing 1000x more compute power). I just find all these game playing contraptions really uninteresting. There are plenty real world problems to be solved of much higher practicality. Moravec's paradox in full glow.
- icc97 8y agoBig Blue relied on humans to do all the training. Alpha Go zero didn't need humans at all to do the training. That's a pretty major shift for humanity.
- DonaldFisk 8y agoIt's Deep Blue, not Big Blue. The parameters used by its evaluation function were tuned by the system on games played by human masters. But it's a mistake to think that a system learning by playing against itself is something new. Arthur Samuel's draughts (chequers) program did that in 1959.
- sangnoir 8y ago> It's Deep Blue, not Big Blue. Big Blue is fine - it's referring to the company and not the machine. From Wikipedia "Big Blue is a nickname for IBM"
- icc97 8y agoI meant Deep Blue, but yeah Deep Blue was a play on Big Blue.
- icc97 8y agoSorry, mix up, thanks for the correction. It's not that it's new, it's that they've achieved it. Chess was orders of magnitude harder than draughts. The solution for draughts didn't scale to chess but Alpha Go zero showed that chess was ridiculously easy for it once it had learned Go.
- carlmr 8y ago>Also it got better than humans in those games from scratch in about 4 hours whereas humans have had 2000 years to study them so you can forgive it some resource usage. Most humans don't live 2000 years. And realistically don't spend that much of their time or computing power on studying chess. Surely a computer can be more focused at this and the 4h are impressive. But this comparison seems flawed to me.
- danielbarla 8y agoYou're right, though the distinction with the parent poster is that AlphaGo Zero had no input knowledge to learn from, unlike humans (who read books, listen to other players' wisdom, etc). It's a fairly well known phenomenon that e.g. current era chess players are far stronger than previous eras' players, and this probably has to do with the accumulation of knowledge over decades, or even hundreds of years. It's incredibly impressive for software to replicate that knowledge base so quickly.
- kelnage 8y agoBut software is starting from the same base. To claim it isn't would be to claim that the computers programmed themselves completely (which is simply not true).
- danielbarla 8y agoSure, there is some base there, and a fair bit of programming existed in the structure of the implementation. However, the heuristics themselves were not, and this is very significant. The software managed to reproduce and beat the previous best (both human and the previous iteration of itself), completely by playing against itself. So, in this sense, it's kind of like taking a human, teaching them the exact rules of the game and showing them how to run calculations, and then telling them to sit in a room playing games against themselves. In my experience from chess, you'd be at a huge disadvantage if you started with this zero-knowledge handicap.
- 8y ago
- bryanrasmussen 8y agothere is no human that has studied any of those games for 2000 years. So I think you mean 4 hours versus average human study of 40 years.
- kenjackson 8y agoAnd didn’t they just do all of this? It’s not like 5 years have passed. Does he expect results like this every month?
- pX0r 8y ago> Also it got better than humans in those games from scratch in about 4 hours whereas humans have had 2000 years to study them so you can forgive it some resource usage. Few would care. Your examiner doesn't give you extra marks on a given problem for finishing your homework quickly.
- adynatos 8y agooh wow, it can play chess. can it efficiently stack shelves in warehouses yet?
- agstewart 8y ago"It" can reduce power consumption by 15%. https://deepmind.com/blog/deepmind-ai-reduces-google-data-centre-cooling-bill-40/ https://deepmind.com/blog/deepmind-ai-reduces-google-data-ce... Just because alpha zero doesn't solve the problem you want it to doesn't mean that advancements aren't being made that matter to someone else. To ignore that seems disingenuous.