18 ms·
Google's AlphaZero Beats Stockfish In 100-Game Match
- cyberferret 9y agoAmazing. I assume AlphaZero knew the basic moves of the pieces, but had to figure out defensive moves etc. against the other computer 'on the fly'? Are those learning games included in the statistics (which include ZERO losses)?? If so, it is a remarkable learning engine. Shades of WOPR. "This is a game nobody can win..."
- animal531 9y agoSeems like it learned by only playing against itself, and for only 4 hours (for the chess component).
- 317070 9y agoYes, it got a set of all legal moves, of which it had to choose one. It was trained for 8 hours where it only played against itself, only using the knowledge of which moves are legal. After self-playing for 8 hours, it played 100 times against stockfish. In those 8 hours, it was apparently able to infer all human knowledge on chess acquired over centuries, and surpass it. And, when the legal moves are replaced with the moves of other games (like Go for which it was actually written, or Shogi), it did exactly the same thing. Redevelop millennia of human knowledge and go beyond, all within 8 hours of compute. Makes you wonder what will happen when instead of the rules of chess, you put in the axioms of logic and natural numbers. And give it 8 months of compute.
- soVeryTired 9y agoAmazing achievement. Still, "eight hours" is a bit misleading. That's eight hours on thousands of parallel TPUs.
- 317070 9y agoLet me reformulate. I'm just saying that there is at least one obvious way in which Google could scale this at least 2 to 3 orders of magnitude if they would want to, for the cost of the electricity bill. Just run it for 8 months instead of 8 hours. And I wonder which problems are feasible when you look at it that way. I mean, they just solved chess in what looks like a warming-up.
- wereHamster 9y agoMore interesting would be how many games it has played in that time.
- andrioni 9y ago44 million, according to their paper, and they used 5000 TPUs, which are capable of 4.6×10^17 operations per second. (The operations the TPU can run are far simpler than what supercomputers can do, but just for the sake of comparison, the current top supercomputer in the world can do 1.25×10^17 floating point operations per second)
- Symmetry 9y agoI haven't seen any details from AlphaZero, but when they were training AlphaGo Zero they drastically reduced the amount of hardware and only used a single node taking about a killowatt of power. If we assume AlphaZero uses the same hardware, then given that a brain uses about 10w that would be equivalent to 800 hours. Which is still amazing.
- pixl97 9y ago>That's eight hours on thousands of parallel TPUs. But it's not really misleading at all. The ability to produce massive amount of power and product is the pinnacle of our society. The fact is we can make thousand, if not millions or even billions of TPUs if we desired, and it is a relatively easy engineering problem at that. And that these things may solve all kinds of problems mankind has had for millennia in hours should be a wakeup call to a future that will be hard to predict. Humans take 9 months to gestate, no amount of parallelism will speed that up, after that it takes 18 years for them not to be completely stupid all the time attempting to hammer an education in them. Even after that it takes more years to become a specialist.
- chx 9y ago> Makes you wonder what will happen when instead of the rules of chess, you put in the axioms of logic and natural numbers. And give it 8 months of compute. How do you score this computation? What's your goal? There's no checkmate here.
- mortenjorck 9y agoI think the idea here is for life to imitate art.
- thomasahle 9y ago> How do you score this computation? What's your goal? Maybe give it a list of problems of varying degree of hardness, and tell it to either prove or disprove as many as possible?
- Will_Parker 9y agoYou could even train it with random theorem expressions run through a conventional theorem prover. And then let it loose on the problems that are left.
- criddell 9y agoI would assume you have to come up with some scoring function. For example, give it a number and tell it to factor it into the prime factors. The score might be the solution with the smallest time or storage requirements. Or maybe find a way to generate a hash where the last n digits are zero. I also remember a RadioLab episode where they talked about electronic theorem solvers and they would do something like show it a video of a double pendulum and it would come up with equations to model the behavior of that system.
- seanwilson 9y ago> Makes you wonder what will happen when instead of the rules of chess, you put in the axioms of logic and natural numbers. If you're talking about formal proofs or maths, I'm not sure how this would apply in general as the branching factor for each 'move' in a proof is efficiently infinite. It would be interesting to see it applied to more constrained proof domains though.
- maxerickson 9y agoIt's inferred a different chess knowledge though, not necessarily including all human knowledge on chess.
- sanxiyn 9y agoYesterday's discussion here: https://news.ycombinator.com/item?id=15858197 https://news.ycombinator.com/item?id=15858197
- megaman821 9y agoDoes anyone know how well a system like AlphaZero can be applied to a field like material science? It would seem that you could make a scoring function against how well the material meets the desired criteria.
- grizzles 9y agoPretty well. There are several active research groups working with AI/ML for materials science research. Since you asked about AlphaZero, here is an article directly about the DeepMind guys working on this problem: https://qz.com/1110469/if-deepmind-is-going-to-find-the-next-miracle-material-experts-dont-know-how-theyll-pull-it-off/ https://qz.com/1110469/if-deepmind-is-going-to-find-the-next...
- seanwilson 9y agoI'm surprised how slow the press has been to pick this up. This seems like an amazing step forward to me. AlphaZero played only against itself as training and it beat one of the best chess AIs in the world that has been finely tuned with decades worth of human knowledge. Now that Go and Chess are efficiently solved for AI...what's next? Are there any other interesting complete information games remaining? What's the next milestone for incomplete information games?
- sanxiyn 9y ago> Are there any other interesting complete information games? Not really, given that they already tried Shogi too. Personally I would love to see AlphaZero playing Arimaa, but it is probably not as interesting because of its short history.
- Filligree 9y agoWell, there's math. Mapping it to AZ and finding a decent "win" function might be hard, but it's a complete information something, certainly.
- sanxiyn 9y agoQuick, someone apply AlphaZero algorithm to this MCTS prover for math: https://arxiv.org/abs/1611.05990 https://arxiv.org/abs/1611.05990 I actually prefer "expert iteration" and "tree-policy target" term instead of "AlphaZero algorithm", because they emphasize what is novel about it among the entire system. Terms are from https://arxiv.org/abs/1705.08439 https://arxiv.org/abs/1705.08439
- animal531 9y agoThe interesting thing for me (apart from the very short training period) is that this seems to be a more generalised version of their previous AlphaGo engine, which means that in future it should be even easier to adapt and use for other tasks.
- 317070 9y ago
- no_gravity 9y agoAlphaZero and Stockfish did not run on the same hardware. So it's not clear if the algorithm is better or the algorithm was just run faster.
- seanwilson 9y agoGiven the algorithm didn't require tuning and it examined less moves each turn I would say it was a better algorithm. Lots of AI problems aren't solved with current techniques just by throwing more CPU power at them so it would still be impressive even if it required a lot of computing power.
- dzdt 9y agoThe thing it does require is specialized hardware (TPU) to run at a reasonable speed.
- pixl97 9y agoA TPU isn't specialized hardware in the same way a CPU or GPU are not task specialized. All three are generic execution platforms that are optimized for a particular type of processing, but do so in a generalized fashion that can complete many different types of tasks.
- animal531 9y agoFrom the pdf: "AlphaZero searches just 80 thousand positions per second in chess...compared to 70 million for Stockfish" But even that isn't the important part in my opinion. They basically created an ML solution that can learn to play these various games, in very little time (hours), while beating other previous engines (by decent to ridiculous margins). They've created a more generalised solution to their previous AlphaGo engine, which may be very useful in future.
- no_gravity 9y ago'AlphaZero searches just 80 thousand positions per second' As I understand it, we don't really know what AZ does when it evaluates a position. As it was not explicitly programmed. It could do something that is similar to evaluating more positions.
- nickjj 9y agoAnother really impressive feat is Elon Musk's OpenAI which defeated a number of world class dota2 players in a 1v1 match. This is a real time strategy video game. The number of decisions you need to make in this game are mind boggling. It takes most people many months, if not longer just to get to the point where you're not clueless. A recap video is at: https://www.youtube.com/watch?v=jAu1ZsTCA64 https://www.youtube.com/watch?v=jAu1ZsTCA64
- erk__ 9y agoOn the other hand it quickly got figured out how to beat it. And it could only play one hero.
- nickjj 9y agoBut it still beat a bunch of top players. I've played dota-like games in the past (at a medium-high level). The skill gap in this game is remarkably huge. It's a type of game where a new human player would get absolutely destroyed with a 0% chance of possibly ever winning, even in a minimal scenario where only 1 hero were involved.
- YawningAngel 9y agoOpenAI isn't a good DotA player though, it's just very mechanically capable at this tiny subset of the game. Still impressive but not really DotA.
- Moncefmd 9y agoStill, they heavily limited the scope of actions of both the player and the agent. It's not like the research space consisted of all the items/actions available in Dota 2.
- TulliusCicero 9y agoThis is mostly meaningless. Of course computers are better at the twitch/mechanical aspects of video games. It's trivial to make an AI that's perfect at Street Fighter or Counterstrike, for example.
- Symmetry 9y agoI'd be curious about how it's strength relative to Stockfish might change as the amount of time per move is varied.
- imrehg 9y agoThere's a graph of that in the Arxiv paper submitted yesterday: https://news.ycombinator.com/item?id=15858197 https://news.ycombinator.com/item?id=15858197 (page 7) As it looks, for move times < 0.2s, Stockfish is stronger, anything above that, AlphaZero is stronger.
- heliumcraft 9y agoYou can see that on page 7 of the paper https://arxiv.org/pdf/1712.01815.pdf https://arxiv.org/pdf/1712.01815.pdf
- margorczynski 9y agoPersonally I was always interested if it's possible now to use them (NN, DL, etc.) to infer theorems on it's own. Because if the difference between it and a human would be as big as we see in these expert-systems (trained only to do one thing) then it could provide amazing results.
- teilo 9y ago>This would be akin to a robot being given access to thousands of metal bits and parts, but no knowledge of a combustion engine, then it experiments numerous times with every combination possible until it builds a Ferrari. No, not even close. First, AlphaZero started with the rules of chess, chess pieces, and a chess board. Second, the possible moves are several orders of magnitude fewer than the steps needed to build a working car out of parts. Closer would be: Here's a car. Here are all the tuneable parameters. Make it as fast or as efficient as possible. But that would still be inordinately more complex then groking chess.
- JustAnotherPat 9y ago>Second, the possible moves are several orders of magnitude fewer than the steps needed to build a working car out of parts. Aren't the number of chess moves, for practical purposes, near infinite? A car can be made only in so many ways, but a chess game can be won under scenarios that outnumber the atoms in the universe.
- personjerry 9y agoIn the same way that the AI’s series of chess moves don’t have to lead anywhere near victory, the system doesn’t have to build anything that resembles a car. With this consideration, there are many more ways to go wrong in the car scenario. Chess moves are limited by the chess piece selection and board. Building something IRL isn’t really limited by anything; For example, you could combine just two pieces in hundreds of ways (tape, staple, weld, etc), in unlimited number of positions (off by 1mm, off by 2mm, off by 3mm, etc).
- dx034 9y agoWasn't chess solved early because the number of possible moves within the next x moves is limited? I think that's the main difference to Go where a bruteforce approach doesn't work.
- bonzini 9y agoChess hasn't been solved; that would mean knowing the perfect strategy, and whether the first or second player can always force a win or a draw. Examples of games that have been solved include reversi, gomoku, connect four and draughts.
- king07828 9y agoLooks like a residual network (ResNet) feeding a Monte Carlo tree search (MCTS) solves the strategy optimization problem. A critique is that the game model (rules, pieces, movements, legal moves) is still bespoke and painstakingly created by a human being. One next step would be for an algorithm that develops the game model as well as the strategy and the I/O translation. E.g., use Atari 2600 Video Chess frame grabs as the input and the Atari controller as the output. After experimentation the algorithm creates everything: the game model (chess, checkers, shogi, go), the strategy for the game, and the I/O processing needed to effect the strategy with the available inputs and outputs.
- afpx 9y agoWould what you're asking for even be possible for a human? For instance, if I plop my child down in front of a game and tell them to figure it out without telling them the rules, would they be able to figure out the complete set of rules even by trial and error?
- nemo1618 9y agoActually, this is a game itself. I used to play it with friends growing up -- we called it "Mao." It's a card game where you are penalized for breaking the rules (at least one person must know the rules in advance). You are allowed to pause the game at any time and guess what a rule is, and the players who know the rules will confirm or deny your guess. You'd be surprised at how quickly people can pick up rules like "only face cards may be played after a 7" or "if an ace is played, the next person is skipped."
- kilburn 9y agoIt definitely is. I learned to play Othello and Backgammon by randomly trying things vs the computer as a child. It is also relatively easy to learn card games' rules, even Poker (albeit some very edge-case rules could take a long time to grasp). The key is that you give the kid a computer version of the game, that doesn't allow rule breaking and makes it clear when a reward or penalty is applied (YOU WIN!).
- nullbyte 9y ago
- rothron 9y agoWhile interesting, it's comparing 5000+ Tensor Processing Units against 64 CPU threads. I suspect this isn't a fair comparison by watts spent.
- sls 9y agofrom the paper: > Training proceeded [...] using 5,000 first-generation TPUs > We evaluated the fully trained instances of AlphaZero against Stockfish, Elmo and the previous version of AlphaGo Zero [...]. AlphaZero and the previous AlphaGo Zero used a single machine with 4 TPUs. So the 5000 TPUs processing power or energy consumption should be compared with those spent in devising Stockfish, not running it.
- bazzargh 9y agoNo - 5000 TPUs were used for training, but the 100-game matches used just 4 TPUs (bottom of p4 in the paper)
- grandalf 9y agoIt's interesting to consider what it means when the AI can succeed without using brute force. Suppose at every turn there are n possible future states of the game based on the rules. To avoid "brute force" the AI must be able to ignore many of those states as irrelevant. In effect, the AI is learning what to pay attention to, not just considering what might happen, thereby conserving computational resources. Chess and Go are interesting for two nearly opposite reasons: 1) because they are too large for humans to consider the reasoning obvious, and 2) because the input to the reasoning is simply a small (and easily perceived by humans) grid of rule-constrained pieces. But when you think of AI in an information theoretic way, so that given representative training data the system (if large enough) will always "learn" perfectly, it's not really all that remarkable. It's just a different computational way of doing the same transformation from input states to moves. Given a problem (chess, go, etc.) the researchers must simply learn what network structure and training regimen will do the job with the least computational cost. To see why this is relevant, consider a deep learning model that could continually generate successive digits of pi (or primes) without having the concept baked in already. Would the result be computationally cheaper than highly optimized brute force algorithm? No, because what it would "learn" would be something already known by humans. Perfect chess is simply a function from input states to moves that humans do not already know the definition of. Most humans do know the definition of this function for the game of tic tac toe by the time they reach middle school. I'd argue that while this is useful it's ultimately not hard. Comparing it with Stockfish mainly demonstrates how chess is hard for humans to reason about and hence hard for humans to write non-brute-force algorithms to solve. Thus, I think this is an example of "weak AI" even though humans associate chess with high degrees of exceptional human cognition. Chess data contains no noise, so the algorithm is dealing only with signals of varying degrees of utility. I'm looking forward to AI that can be useful in the midst of lots of noise, such as AI that analyzes peoples' body language to predict interesting things about them, analyzes speech in real time for deception, roulette wheels for biases, and office environments for emotional toxicity. Chess is interesting because we can't introspect to understand what makes humans good at chess (other than practice). So many human insights and intuitions are similarly opaque yet the data is noisy enough that it will take significantly better AI to be able to do anything that truly seems super-human.
- asimpletune 9y agoI have to say it’s a completely inappropriate comparison to make since Stockfish was forbidden from using its opening book. I would like to see the results when both are at their best.
- mtzguido 9y agoIndeed. Most engines are pretty bad without their opening books. There was surprisingly little stress on this.
- foobaw 9y agoActually, have you seen matches between SF without opening books vs SF with opening books? This isn't true anymore as far as I'm know.
- thomasahle 9y agoDo you have any links to such matches?
- stouset 9y agoMost engines don’t have opening books any more and haven’t for years.
- nilkn 9y agoAnother way of looking at it is that it would be inappropriate to give Stockfish an opening book but not AlphaZero, and I'm guessing the latter doesn't have one since that goes against its whole premise. With that said, whether it's fair or not, I am curious to see how Stockfish with its opening book would compare to AlphaZero in its current state.
- Certhas 9y agoEdit: I just learned that things have changed quite a bit since I looked into computer chess more deeply, and Stockfish does actually not use a book. So they did play the default config. The below is thus completely off. -- These engines are built for results, not as technical demonstrators. You are testing the engine in a scenario that it was not built to cover. Opening books are not optional add ons for these engines, they mean that the heuristics are not tuned for early game, and no work is put into optimizing the evaluation in that phase of the game. If they could have beaten Stockfish in its default configuration (using book), they wouldn't have artificially weakened it, right?
- rurban 9y agoBut now please Houdini and the rest. Stockfish doesn't play interesting, and has less ELO than Houdini. Though that new search will beat Houdini also I guess.
- otaviokz 9y ago>This would be akin to a robot being given access to thousands of metal bits and parts, but no knowledge of a combustion engine, then it experiments numerous times with every combination possible until it builds a Ferrari. That's all in less time that it takes to watch the "Lord of the Rings" trilogy. The program had four hours to play itself many, many times, thereby becoming its own teacher. This absurd comparison would raise my eyebrows coming from an English tabloid. Having said that I've looked the author's profile and was appalled to learn he's a chess prodigy. Then I also seen he's a Chess Journalist. Apparently he became much more a journalist than a chess master...
- blondie9x 9y agoFour hours to learn on a high speed computer is what millions upon millions of games? Thousands of human lifetimes lived out in four hours. The four hours to learn thing is fake news and distorts the reality of how many games and trials the machine actually went through.
- mikeash 9y agoI disagree. I think people understand that computers are fast, so millions of games is implied in "four hours." The fact that it only took that much time, starting from nothing, is still incredibly impressive.
- kazagistar 9y agoI don't think so. It seems to me that the whole point of AI is how many real world human years it saves by mastering and executing things fast. The fact that it can learn this well at all, after any amount of time, makes it impressive, and the fact that it learns quickly makes it all the more useful.
- pixl97 9y agoHow fast can you exchange and learn information? How fast can you figure things out and then teach them to other humans around you? Your processes don't scale well, beyond the biological scaling that your body has developed via evolution in the last 4 billion years. Digital processes do.
- ouid 9y agoI think the real measure of an AIs success in this field is the absence of pathological boards like this one. https://lichess.org/analysis/8/p7/kpn5/qrpPb3/rpP2b2/pP4Q1/P3K2b/8_w_-_- https://lichess.org/analysis/8/p7/kpn5/qrpPb3/rpP2b2/pP4Q1/P... Is it still easy to find positions that alphazero totally misunderstands?
- tialaramex 9y agoSuch positions are not interesting to Alpha unless it might run into them. If Alpha would never choose moves that lead to this position, it needn't have any insight into them. If a Hold'em AI would never choose to bet 72 off it doesn't need to have an opinion of what to do when that bet is raised by the opponent.
- ouid 9y agoSorry, I missed this response. The goal, to me, for a chess playing AI, is not that it be very effective at the game. We have already shown that simple algorithms exist which are better than humans. The novelty presented by Alphazero is the generalization of positional evaluation with deep learning structures. If you present Alphazero with this board, and ask it to learn how to play starting from this position, what does it discover? Does that translate to other "similar" pathological boards?
- jtraffic 9y ago> Nielsen is eager to see what other disciplines will be refined or mastered by this type of learning > of course it goes so much further > The ramifications for such an inventive way of learning are of course not limited to games. >But obviously the implications are wonderful far beyond chess and other games. The ability of a machine to replicate and surpass centuries of human knowledge in complex closed systems is a world-changing tool Okay then. Let's go beyond games already!
- reader5000 9y agoNumber of humans that could put together a Ferrari from parts: ~10000? Number of humans that can beat Stockfish: 0
- albertgoeswoof 9y agoNumber of cats that can meow: ~1000000000000? Number of cats that can beat Stockfish: 0
- bluecalm 9y agoAnd therefore meowing is simpler than beating Stockfish which was parent's point.
- soVeryTired 9y agoA trillion cats meowing at once would obviously destroy the earth.
- teilo 9y agoTry again with: Number of humans that could assemble a Ferrari from discrete parts: who have never seen a car before, have no training to build or maintain a car, and no instructions other than "car must work."
- RcouF1uZ4gsC 9y agoNumber of humans that can leverage computers to beat Stockfish: At least the number of humans on the Deep mind team. Number of humans that can create AlphaZero:At least the number of humans on the Deep mind team. Number of computers that can independently create AlphaZero: 0
- periya 9y agoGive it 10 years maybe.
- erikpukinskis 9y ago
- partycoder 9y agoYou will see here how Stockfish improvements are tested. http://tests.stockfishchess.org/tests http://tests.stockfishchess.org/tests Some code or weight is changed, then they have it play to see if it leads to better performance. An exhaustive, sort of manual work. On the other hand Deepmind's bot is fully automated and they have it just running day and night improving itself on a large hardware configuration.
- romaniv 9y agoWhat I'm reading: an existing chess engine that runs on much poorer hardware and for some weird reason was deprived of its usual initialization data achieved 73% draw rate against a ridiculously hyped "deep" neural network/MCTS algorithm. It's interesting that AlphaZero was finally applied to a different game, though. I wonder what architectural changes they had to make. I've read that pure MCTS isn't that good at playing Chess. How true is that?
- qeternity 9y agoAlphaGo and AlphaGo Zero are different than Alpha Zero.
- red75prime 9y agoAll the hardware you can throw at Stockfish probably will not do much of a difference, as DeepMind will just train AlphaZero for another couple of hours to surpass it. Draws are common in high-level chess. There's a belief that perfect play by both sides will result in a draw. They changed input format and amount of noise (which facilitates exploration) to account for different branching factor.
- scott00 9y agoCan any computer chess/stockfish experts comment on the choice of 1 GB for hash size? I have no chess or computer chess domain expertise whatsoever, but it strikes me as a suspiciously low setting for a memory-related parameter on what was probably at least a 32 core machine. It makes me wonder if they simply dialed down the hash size until they got a nice convincing win. Update: took a look at settings used for TCEC. Looks like they used 16 GB in season 7, 64GB in season 8, 32 GB in season 9, and 16 GB in season 10. Two observations: (1) interesting that they've decreased hash sizes in recent years (2) definitely seems like 1 GB is not reflective of how an engine would be configured for TCEC.
- shmageggy 9y agoIt does seem low, but I doubt the effect on performance would be huge. Certainly not enough to affect the major claims of the paper. For example, on my 4-core machine I just loaded up two instances of Stockfish, one with 32MB hash and one with 512MB, and assigned 2 cores to each. I loaded up a few random middlegame positions, and after analyzing for 1 minute, the evaluations and main lines were generally the same (within the margin of error for repeated runs of the same engine). when analyzing the Kasparov's immortal game, it was a toss-up which engine would find the famous rook sac first. 1GB is probably suboptimal on the hardware they used, but the difference is probably minimal.
- joefkelley 9y agoFrom what I've read scattered across a few different chess discussion places, the consensus seems to be that a) yes, 1 GB is pretty small b) it would matter, but c) probably not enough to change the end result. I guess we will have to wait for next year's TCEC for the final verdict though. Hope they change the hardware specs in some way that would allow AlphaZero to compete.
- erikpukinskis 9y agoQuestion for the AGI believers out there: We have this, state of the art, AI which can turn the screws and hone in on some underlying reality about “how to win at Chess”, a formal game. Great. How does this then extend into the social domain, where AGI would be operating? Like, how does AlphaZero optimize for “how to slow Climate Change”? I can’t even fathom how it would even understand climate change without an army of scientists publishing new work for it to consume. And then on top of that it will need to understand how it’s adversary, Putin, will try to optimize for the opposite, “ensure global warming to open up our shipping routes and arable land”. It just seems like a non-starter to me. Saying you could win at chess, so winning at geopolitics is just a scaling problem to me is like saying I can drink a bowl of miso soup so drinking the ocean is just a scaling problem. It would seem to me that intelligence at the highest levels isn’t constrained by foreknowledge, it’s constrained by the consequences of past decisions made during the (inevitably ongoing) interactive learning phase.
- RivieraKid 9y ago> Like, how does AlphaZero optimize for “how to slow Climate Change”? It doesn't, AlphaZero is a domain specific AI. That's like asking: "Like, how does differential equation solver slow climate change?". AlphaZero can learn to play a narrow class of games given the rules, that's all it does. But I agree with your sentiment obviously. We're n technological breakthroughs away from AGI, where n is unknown. We have approximately zero idea how to move from DNNs to AGI - or weather DNNs are the right approach.
- epaga 9y agoYeah, seems like weather DNNs might be the right approach for solving Climate Change.
- romaniv 9y ago> Like, how does AlphaZero optimize for “how to slow Climate Change”? I think that's a bit ambitious. GAI is not obliged to solve all the world's problems. But I would ask a more modest question: how could AlphaZero approach problems like web service integration? These problems are definitely solvable, but converting them to optimization problems is the really difficult part that requires genuine intelligence.
- deleted 9y ago[deleted]
- cerealbad 9y agoseems like the real untapped potential goldmine here is to carefully observe millions of workers, notice when they are working and why and when they are slacking off- and enforce penalties and rewards relative to their peak performance to motivate increased productivity. measure average key presses, response times, eye engagement, fidgeting and body motion, facial expressions. do you really need robots if you can train the human network to be more robot like? the 21st century assembly line is so delicious, think of the possibilities. going to need stimulants to work at 100% or your company AI will cut your pay.
- ken47 9y agoIf AZ is truly superior to Stockfish, why was Stockfish given an amount of RAM that could only be considered standard for the 1990s?
- forgot-my-pw 9y agoSome in the chess community seems to be still in denial phase. The Go/Baduk community has experienced the similar thing early last year. - Jan 2016 (AlphaGo beat Fan Hui): Fan Hui was only a 2p and European champion, he's no way near the top - Mar 2016 (AlphaGo beats Lee Sedol): AlphaGo still lost 1 game. The #1 rank player can probably still beat it - Jan 2017 (AlphaGo Master beats 60 pros): Ok, AlphaGo is strong, but those are only online games with short time control. - May 2017 (AlphaGo Master beats #1 ranking, Ke Jie): ... - Oct 2017 (AlphaGo Zero beats AlphaGo Master): Ok, nothing we have right now can probably beat it.
- roenxi 9y agoYour point is correct, but the thing to note is that until AlphaGo I don't think we've seen an AI improve quite that fast. The AlphaGo Fan had an elo ~3,150 and it was correct that Lee Sedol (elo ~3,500) would win against it. Google showed up to play Lee Sedol with a ~3,750 elo network. 600 elo in 6 months is basically unprecedented growth in Go AI strength, and took AlphaGo from "it can play a good professional game" to "gee, maybe the No. 1 human can take a game off it". I'm getting the number from the AlphaGo wiki page.
- conistonwater 9y agoThink low-hanging fruit, I'd say: 600 Elo could be reasonable for a very new idea with lots of improvements still left to try. AlphaGo's improvement definitely petered out later, the difference between Master and Zero is nowhere near that big. On that basis, the skepticism still seems a bit wrong to me.
- RivieraKid 9y agoDenial of what? That one chess engine dethroned the currently best one? This happens every second year. And doesn't make sense why the chess community would be in denial, did you mean chess engine community?
- jsemrau 9y agoYou are absolutely right. We have build machines to augment human capabilities for thousands of years. I don't see an optimized chess engine on the same level of innovation as a racing tire. A great engineering feat and accomplishment, but not entirely groundbreaking.
- CGamesPlay 9y agoDid DeepMind publish anything about this? Is this literally a straightforward plug of the AlphaGo Zero techniques into a chessboard with no novelty? Don't get me wrong, I'm impressed, I'm just looking for a more primary source.
- wrsh07 9y agoThe arxiv paper is here: https://arxiv.org/abs/1712.01815 https://arxiv.org/abs/1712.01815
- logicallee 9y agoCompletely dishonest title and first 1,000 words of the write-up. That's when you get to the words: > pointed out that Stockfish's methodology requires it to have an openings book for optimal performance. I went from amazed, utter shock like "What!! No way. This is unreal. This is absolutely unreal. What? What? What?" to a total feeling that I've been reading 1,000 words of fake news. I feel cheated by this write-up and flagged it for this reason. They need to mention it in the first couple of words, not after selling that it has deduced 1600 years of human chess knowledge in 4 hours.
- skarist 9y agoThis is of course all very, very impressive, but it would be great to see more details on this. We are told AZ only started with the basic rules. What was included in the "basic rules"? How were they codified? The engine looks at 80.000 positions at second, so obviously it has some evaluation function. What is the position evaluation function? Presumably it was codified in some way in the beginning, and then got improved by the training period? It would be very interesting to see the first 100 games, or so, the engine it played against itself.