10 ms·
While I can understand Lee Se-dol's frustration, I think there are better lessons to learn from Kasparov's acceptance after the Deep Blue vs Kasparov matches.
by dragontamer 7y ago
While I can understand Lee Se-dol's frustration, I think there are better lessons to learn from Kasparov's acceptance after the Deep Blue vs Kasparov matches.
Cyborg chess is the future of chess. Period. Chess players use computers to train themselves and explore openings in human-only settings, while programmers / cyborgs play correspondence chess.
Go is not finished as a game. A new tool, MCTS + Neural nets, has been developed to explore the "truth" behind the game at ever increasing rates. Its not about how to beat the tool, the question is how to best utilize the tool to improve self-play and self-learning in the game of Go.
Or alternatively: how to best use the tool to play ever more perfect games of Go.
-----------
Come on, none of us are really "human" anymore since the advent of cell phones. We all use our cyborg-capabilities to search the internet and fact-check ourselves every day. Programmers use stack-overflow to teach themselves programming and remember obscure details (using our cyborg capabilities to tag, search, and sift through information ever faster and faster).
Go is the same thing, except we only learned how to become cyborgs two years ago.
----------
Give the world-champions each a copy of AlphaGo on equal computers. Have them play Go against each other WITH computer assistance. I guarantee you that a more beautiful and perfect game will result. Let us welcome the age of Cyborg Go as we step into the future, we shouldn't be scared of it. We've become cyborgs in many other tasks, and Go is no different.
- rhizome 7y agoEh, the good part of a computer Rubik's cube solver is not seeing the cube solved in nanoseconds, it's in making the computer. The cube itself is just a unit test.
- dragontamer 7y agoBut a Rubik's cube solver is a single-player, solitaire game. Its fundamentally different. Over in the "Cyborg Chess" community, people have already analyzed LeelaZero vs Stockfish. It turns out that Stockfish is far better at tactics (especially the endgame), while LeelaZero is better at opening positions (aka: Positional play). There are numerous theories about the proper combination: perhaps using an Opening Book database for the first ~10 moves or so, using LeelaZero for moves ~10 through 30, and then using Stockfish to check for tactics (LeelaZero misses a lot of tactical options in the midgame, so double-check to make sure that LeelaZero doesn't lose a queen or something), as well as finish up the endgame. -------- Choosing the correct combination of tools, studying these tools and coming up with a more beautiful chess game. That's cyborg chess in a nutshell. LeelaZero and Stockfish are both superhuman in terms of play, but the cyborg can choose to use both tools to play superior compared to just a singular tool. Anyone purely using "Stockfish only" gets beaten by opening book analysis. The dude over there with 1TB of opening book databases consisting of every losing position that Stockfish tends to play will completely own you. Same thing with LeelaZero, the opening book guy will own any LeelaZero-only player. These engines have weaknesses that can be undermined with good analysis, big-data, and a bit of custom code. That's the funny thing about these computers: they tend to play the same. So you can build opening book databases to exploit their patterns. You require a cyborg / human to play at the "level above that" to guide Stockfish / LeelaZero away from those traps.
- lern_too_spel 7y ago> So you can build opening book databases to exploit their patterns. And then program the computer to use that opening book directly. Now what is your cyborg player going to do? After you patch all these easy rules, you will have to discover harder rules, and the computer can discover them faster than you can.
- dragontamer 7y ago> Now what is your cyborg player going to do? Build and configure the machine better. Quick, tell me, what's better at playing Chess: * Or is Xeon Platinum 8180 with maximum 8-way SMT memory sharing with a big-ol 1TB shared transposition table the fastest computer? * Or will it be cheaper to rent AWS-instances with their V100 GPU in the cloud? Or is the latency for the remote-access bad? -------- The cyborg player has to still build and program the machine to compete. It is all part of the competition. Can you run a transposition table shared between chess engines over RDMA 10Gbit SFP+ Fiber? Or is that too slow? ----- This isn't hypothetical at all. The winner of the World Computer Chess Championship 2019 was 8 x Intel Xeon Platinum 8168 running Komodo vs 24 x Amazon AWS Intel Xeon E5 running Shredder. Configuring and building the computer is still an incredibly difficult part of cyborg chess.
- lern_too_spel 7y ago> Build and configure the machine better. It's a stretch to categorize that as a cyborg player. You might as well categorize any chess program as a cyborg player because a human had to program and train it. The key difference between cyborg/centaur/advanced chess and plain old computer chess is whether there is a human in the loop making the move decisions. My argument is that having a human in the loop will result in a worse player.
- dragontamer 7y agoAt a minimum: building the opening book alone will require human intervention. When you build an opening book, you need to pick-and-choose which engines will self play. Will you build an opening book vs Stockfish? Komodo? LeelaZero? If so, how will you generate these LeelaZero games? You'll have to build a computer (or rent one from AWS) to play these LeelaZero games. What are the time-controls of matches? Self-play at 40-minutes + 15-second increment means that you'll only create a game every hour or so. Spend 30-days building databases at 40-minute + 15-second increment games, and you'll only reach ~720 games of analysis per month of preparation. Self-play at 1-minutes + 0-second increment results in a game win/loss every 2-minutes (maximum), giving you 21600 generated opening book positions per month of analysis. But these 21600 games are of lower-quality. ---------- Spend 1-month building an anti-Stockfish database, an anti-LeelaZero database, an anti-Komodo database... and you're now 3-months into preparation and there's still Shredder, Johnny, and all other programs that may arrive at the contest. Its not exactly as easy as you think it is. There's no algorithm that automatically builds the best opening book (or "counter" opening book) against your opponents. Its a human choice for what the computer will spend the next-3 months self-analyzing and self-playing. Lets think about how to build anti-LeelaZero seriously. Which of these networks do you download as the LeelaZero representative? https://lczero.org/networks/ https://lczero.org/networks/ You don't have the time to build an anti-opening database for all of those networks.
- short_sells_poo 7y ago> Come on, none of us are really "human" anymore since the advent of cell phones. I really like the way you put it. In isolation, humans today have essentially the same natural mental capacity we had 2000 years ago, but we've become part of a much bigger computer. A human brain 2000 years ago was a very isolated entity. Even in centers of learning in the classical era, the amount of knowledge one could tap into was vanishingly small compared to our capabilities today. Everything and everyone was isolated in both space and time. A brain today is not just an entity on it's own, it is intricately wired into the common consciousness. Crucially, we have a vast database of knowledge - easily searchable and distilled for maximum learning rate - all available at our fingertips. A modern brain is a neural network linked to billions of other neural networks, and all of them are linked to a shared memory that they can use at will. Assuming that the main limiting factor is the bandwidth between a human brain and computers (and thus by extension between individual humans), then a direct interface could ostensibly bring about a new revolution (for better or worse).
- r3trohack3r 7y agoI've woven this sentiment into my philosophy. I feel computers (and the networks between them) are a natural evolution of our hive mind. When we first started taking spoken language and committing it to writing, we created a hive mind that extended beyond a generation. Prior to that point, everything was passed on through observation of other humans (observing behavior, observing speech, etc.). This meant everything had to pass through, and be mediated by, a human brain. Once we committed that to writing, we had a direct line back to the original brain that created the content unencumbered by the mushy grey bits that have consumed and regurgitated it since. I feel we are still iterating on that. Cataloging our collective minds and building ever low latency systems to navigate those catalogues. Computers are just an extension that improved our ability to catalogue and retrieve the contents of each other's brains in an incredibly low latency way. We are part of a hive mind. Our industry is actively building the load bearing infrastructure that supports our hive mind.
- Xc43 7y agoI am not a bee. I have no queen. I am not part of a hive, I am a social individual. This hive mind over-simplification is ridiculous and to me: disgusting. As if we were one
- DiogenesKynikos 7y agoGarry Kasparov might be a bad example, since his immediate reaction to losing to DeepBlue was to accuse the IBM programmers standing on stage next to him of cheating (through human intervention in DeepBlue's moves). But generally, humans have accepted computer supremacy in chess pretty well. Everyone realizes that a better chess-playing entity exists out there (in everyone's pocket, in fact). That doesn't make the competition between human players less exciting. It's still a match to prove that you're better than the person sitting across the board from you, and it's still incredibly impressive to see how deeply and accurately the top players can calculate, or how much knowledge they have of the game.
- invalidOrTaken 7y agoTalking with a co-worker the other day, I unthinkingly articulated a question that made us both stop and think a bit: "Could a human beat a computer at chess?" Like, now. 20 years after Kasparov. Could someone do it? The question feels daring somehow.
- yifanl 7y agoIn fair conditions and against a top-performing chess bot, simply no seems like the correct answer. If you're asking how a human can contrive a scenario to beat Stockfish/Leela, that seems like just a conversation that devolves into what is and isn't too contrived.
- stevekemp 7y agoThat reminds me of a story .. https://en.wikipedia.org/wiki/The_Feeling_of_Power https://en.wikipedia.org/wiki/The_Feeling_of_Power
- mensetmanusman 7y agoSounds like the plot of a good movie!
- Thorrez 7y agoIf the computer has a bad algorithm, or if the computer has a low powered CPU, then yes.
- Quarrelsome 7y agoWe should note that Kasparov was actually wrong at the time. Alpha Zero has proved this by smashing Stockfish every time it plays it. The contemporary thinking around chess theory including the measures that DeepBlue would brute-force towards were inherently lossy and nobody figured it hard enough. Technically, at that time DeepBlue could have been beaten by understanding Alpha Zero's theorems before Alpha Zero discovered them. So there was a window between the 90's and today where a human player could have discarded the traditional measuring sticks of "trade-value" and beaten DeepBlue. Maybe that's not true today or maybe there's a further theory out there?
- dragontamer 7y ago> Alpha Zero has proved this by smashing Stockfish every time it plays it. Google played Alpha Zero vs Stockfish under their own conditions. I think this was a mistake to stay in the labs by themselves. I think Google would have benefited from participating in WCCC 2019 for example, where Johnny (1200x core cluster) won the day. ---------- Its a completely different field when you're actually competing against someone else. Google did some impressive things in the lab for sure, but they have NOT actually stepped into the competitive ring yet. I'm sure AlphaZero is good, and probably would make a good showing at one of these contests. But you're putting the cart before the horse here. EDIT: Maybe MCTS + Neural Nets truly is the superior way of preparing board game knowledge? If so, the next step is building out the opening-database and to start looking for holes where AlphaZero loses. It wasn't a complete blowout: AlphaZero lost some games to Stockfish. Why did AlphaZero lose in those games? Is there a set of opening moves that will lead AlphaZero down that losing path in a true competitive setting? --------- EDIT: Case in point: Google did NOT incorporate randomness into AlphaZero's algorithm. It always chose the best move it believed in, this leads it prone to opening database attacks. See how the competitive mindset already messed AlphaZero's careful laboratory preparation up already? Sure, AlphaZero 2.0 might have programmed randomness added to it, if this were a true competitive environment. But that's how cyborg chess evolves: I point out a weakness in the program, exploit it in a game, and then Google goes back to their labs to make something better next year.
- ummonk 7y ago
- LeifCarrotson 7y ago> Give the world-champions each a copy of AlphaGo on equal computers. Have them play Go against each other WITH computer assistance. Two problems with this plan: (1) the best players at human vs. human Go are likely not as good at playing on a human/computer team, and (2) it may be that the world champion human/computer team is the one that defers 100% to the computer, which seems uninteresting.
- dragontamer 7y ago> (2) it may be that the world champion human/computer team is the one that defers 100% to the computer, which seems uninteresting. AlphaZero doesn't have any randomness built into it, does it? Which means I can build preparation against the lines of play AlphaZero would want to go down. I think you're underestimating the human, and also overestimating Google's laboratory experiment here. No one has really played "Cyborg Go" yet. The first casualty of "Cyborg Go" will be AlphaGo in its current form: its clearly inadequate for AlphaGo to play deterministic. Random play MUST be incorporated, lest opponent's preparation sends it down the wrong path. If I know that AlphaGo plays slightly worse on 3-4 opening (or 4-4opening, or maybe even the 10-10-opening), then that's what I'll do. Give me a copy of AlphaGo and I'll be able to find a weakness somewhere.
- CydeWeys 7y agoAlphaZero uses Monte Carlo Tree Search. It definitely has randomness built in. I'm with the other guy; I don't see how a person could make the AI play any better.
- dragontamer 7y ago> AlphaZero uses Monte Carlo Tree Search. It definitely has randomness built in. That's not what MCTS means. MCTS refers to the bandit problem which formulated the search parameters. MCTS always chooses the "most interesting" path to explore. (Where "most interesting" is the path that balances explore-and-exploit hyper-parameters). AlphaZero improved upon MCTS by deferring to the neural net as the hyper-parameter. But AlphaZero, for a given network on a given board-state, will ALWAYS choose the same position as "most interesting". Turning AlphaZero from its current deterministic form into a random form would be an easy fix. But its just one example of how AlphaZero really isn't designed for competitive use yet (despite playing the best game of Go of all time). Instead of picking the top #1 move, maybe you randomly pick from the top 3 moves... or some other scheme.
- jimbokun 7y ago> Come on, none of us are really "human" anymore since the advent of cell phones. We all use our cyborg-capabilities to search the internet and fact-check ourselves every day. Programmers use stack-overflow to teach themselves programming and remember obscure details (using our cyborg capabilities to tag, search, and sift through information ever faster and faster). Sure and any of us could jump on a motorcycle and fly past Usain Bolt in the 100m, but that kind of misses the whole point of the competition. > Give the world-champions each a copy of AlphaGo on equal computers. Have them play Go against each other WITH computer assistance. Won't the winner be the one who just takes AlphaGo's recommended move every time without changing anything?
- AllanHoustonSt 7y ago> Won't the winner be the one who just takes AlphaGo's recommended move every time without changing anything? That's only true if AlphaGo never makes a mistake or if AlphaGo will 100% always make the better or equal decision than a human + computer at any given state of the board. I know the former certainly isn't true and I assume the latter isn't true either, but I don't know enough about Go to say for sure.
- sukilot 7y agoLike self-driving cars, it's not enough to outsmart AI on one move, it's necessary to outsmart on AI with positive expected value over all the moves you are confident enough to weight in on.
- joosters 7y agoSelf-driving cars is a terrible comparison, especially since the state of the art right now is that the best human drivers far outpace the best AI driving, in both skills and flexibility. Plus, you only have to outsmart the car AI once to 'win' - e.g. just override one 'drive into the highway barrier' or 'run over that pedestrian' AI mistake.
- gizmo686 7y agoAlphaGo (and, presuably, any AI system with a remotely simmilar means of operation) can output a score for each move. Actually, AG can output 2 scores: win percentage and branches explored. You can use the relative scores to decide when to overrule the AI. Eg, if move A has a 50.1% win chance with 2k branches explored, and B has a 50.2% chance with 1.9k branches explored, I would go with the opinion of an expert human, as AG thinks the moves are essentially equal.
- AllanHoustonSt 7y agoThis is the current state of online poker. I enjoy it in the spirit of the game as a fan but it's definitely made earning potential and barrier of entry much higher. Poker stands on a net negative economy so the game is converging to a point of being unbeatable unfortunately.
- JackFr 7y ago> Come on, none of us are really "human" anymore since the advent of cell phones. Come on, none of us are really "human" anymore since the advent of writing.
- sukilot 7y agoCome on, none of us are really "human" anymore since the advent of gut bacteria.
- naniwaduni 7y agoCome on, none of us were ever really "human" since the advent of eukaryotism.
- elefantastisch 7y agoThe comment about cyborg chess is spot on. This is why AI is more significant to Go than horses and cars are to running. It's easy for humans to build machines that enable them to travel faster than they could run, but it has zero impact on running as a sport. The existence of cars doesn't change how runners run. But the existence of AI does change how Go players play. Now that AI is more powerful than human players in chess, it is no longer possible to reach the top of human performance in chess without AI. That's why this is so significant. It's not that a human can't beat the AI. It's that a human can't beat another human without learning from the AI. You simply can't play chess at the highest levels anymore without playing cyborg chess. This is different from the impact of other machines on other sports. But I disagree with you on the comparison to how we use the internet to enhance our other abilities, such as programming. Computers help us be better programmers, but they can't replace us. AI completely replaces humans as a Go player. The human is no longer needed at all. I can see this causing a significantly different psychological response. In effect, a human trying to become the best chess player or best go player they can become is trying to more and more closely emulate a computer that they will never actually reach parity with. Another commenter noted that "A Professional Go player is an explorer of truth in a millenarian board", but this is less and less true as AI improves. All knowledge about the best way to play Go was previously gained by humans. In 20 years, humans will probably be meaningless on driving knowledge of perfect Go playing. Chess players today rely on playing moves which their opponents don't expect and haven't trained on as much as they rely on outplaying their opponents. If there is a perfect chess game or a perfect go game, humans are not going to help find it anymore. So AI doesn't make it that humans can't meaningfully compete in games such as chess and go, but it does change how they compete. We no longer drive the pursuit of perfect play as "explorers of truth". We no longer learn primarily from each other, we learn by imitating the more powerful, yet unmatchable, AIs. And we no longer compete primarily on sheer expertise in the game. We have to, in some sense, include trick plays that work by exploiting the humanity of our opponents rather than playing for a platonic ideal of the game and seeing who is better from that perspective. AI has fundamentally and irreversibly altered these games, and I think it's appropriate in some sense to mourn the loss, regardless of our feelings on the new reality we live in.
- blondin 7y agothis is more in line with what i am thinking. maybe our evolution is not complete yet. maybe we will improve? maybe our next step would have us interact with data and information at the speed of computers if not faster. then what?
- rpearl 7y ago> Come on, none of us are really "human" anymore since the advent of cell phones. We've been cyborgs much longer than that! Writing is a very old auxiliary memory mechanism. See also: Truth of Fact, Truth of Feeling by Ted Chiang - http://archive.is/oYo0l http://archive.is/oYo0l
- btilly 7y agoChess is a very different story than Go. When computers became able to beat humans, the tradeoff was that computers were better tactically and humans better positionally. Therefore a human computer pair with the ultimate decision up to the human is able to be a better combination of positional and tactical than either alone. This is why Cyborg chess works so well. But in Go, AlphaGo is simply better at everything. It is better both positionally and tactically. It can't always explain why the move is right, but adding human intuition on top of the computer only detracts from the quality of play.
- namirez 7y ago> Give the world-champions each a copy of AlphaGo on equal computers. Have them play Go against each other WITH computer assistance. I guarantee you that a more beautiful and perfect game will result. Probably for a few years. Very soon the input from the human agents will be indistinguishable from the noise in the AlphaGo algorithms.
- cabalamat 7y ago> Come on, none of us are really "human" anymore since the advent of cell phones I agree, and this could also be rephrased as we're not really human any more since the advent of writing or (especially) printing.
- tempsolution 7y agoSorry, but this doesn't make much sense. Playing Chess and Go to start with is already a kindof questionable use of anyone's time. But if you know that a computer will demolish even the worlds best players, transforms this into a hobby. There is literally no point in spending 20 years frantically training a useless skill that every computer can do better. Mankind should focus on skills that computers can't yet compete at. Hopefully the point in time will be far off where computers will beat humans at everything, but likewise, once they do, there is no reason for the human race to continue to exist.
- Symmetry 7y agoThere was about a decade after Deep Blue's victory in 1997 when human/computer teams were the champions of centaur (human+computer) chess. The computer's ability to simulate many moves ahead plus a human's intuition was a winning combination. But as computers got better eventually the communication overhead meant that human/computer teams started losing to computers playing on their own with the human only slowing things down. It would be nice if we got a decade of centaur Go but I'm not sure we will. While Deep Blue had fairly crude heuristics for guessing which lanes of inquiry were promising AlphaGo's strength is its intuition-like neural networks that it combines with a rigorous tree search. It's worth investigating whether human/computer teams are superior at Go right now but I wouldn't count on the answer being "yes." And I especially I wouldn't count on a full 10 years of combined dominance.
- zitterbewegung 7y agoCyborg chess is here. As we have seen in the latest championship blitz chess is the future for chess. Computers compete in their own championship.
- deleted 7y ago[deleted]