6 ms·
AlphaGo – The Movie [video]
- londons_explore 7y agoCan anyone who has watched the whole thing give a summary for those of us not sure if we should dedicate a full 90 minutes to this?
- tgpc 7y agohumans: go is hard. machines will never be able to play at the highest level. machines: I have won humans: oh
- gwern 7y agoI've been reflecting on exponentials and humans in light of coronavirus. AlphaGo showed the same dynamic: I don't know if everyone remembers, but before the Lee Sedol tournament, most 'sensible' 'respectable' people assumed that there was no way AlphaGo would win, any claims it would stomp Lee Sedol were hyperbolic AI alarmism, and the only question was whether DeepMind would be saved from acute embarrassment by eking out one victory over Lee Sedol or if he would simply clean the board with AG. And in the absolute worst-case scenario, it might be a fairly even match. After all, anyone could look at the Fan Hui vs AG games which were released a few months before and see that AG was really crappy, hardly even human pro level; Lee Sedol wouldn't break a sweat. Yes, it would improve if they trained it more and tweaked it more, but so what? There were so many ELO points between Fan Hui and Lee Sedol, and AIs lack human intuition. Just drawing a line is mindless curve-fitting, which sensible respectable people know better than to do. Meanwhile, people like Eliezer Yudkowsky considered the training time and thought through the exponential graph, and concluded that, given all those months between Fan Hui and the tournament and the fact that DM was willing to do the tournament at all with so much money on the lines, AG would either lose terribly or could well go 5-0. As it happens, his prediction was wrong. It actually went 4-1, because Lee Sedol got lucky and accidentally triggered a 'delusion' (fixed in AlphaZero). We went from 'the best MCTS might be somewhat competitive with a very low-ranked human pro head-on' to 'superhuman' in a matter of months, because AG performance scaled with compute. We've seen similar capability leaps with DoTA2 or SC2: the best non-cheating AI was so low level it basically didn't exist (DoTA2) or was nowhere near competitive with any pros (SC2) and then within a few months of finding a working architecture (compare Oriol Vinyal's demo at Blizzcon to the matches just a few months later with SC2 pros), they reach better-than-most-pro levels even if they are not strictly superhuman yet. That's all fun and games when it's just board games or computer games, of course...
- roenxi 7y agoThat wasn't quite the dynamic; the version that played against Fan Hui was pretty good. That would have been more than enough to claim that the AI was highly competitive against human professionals. The surprise was that it was assumed that Neural Nets would scale exponentially like other computer projects - over the medium term, with a requirement to rewrite the program to take advantage of new hardware opportunities. The idea that the same program + 6 months could scale exponentially was pretty radical even to people who knew a lot about computers. I was certainly surprised because I'd made the assumption that AlphaGo could scale exponentially with improvements in graphics cards as opposed to exponentially with Google's commitment of computer hours. Obviously wrong in hindsight, but it wasn't a misunderstanding of exponentials, it was a misunderstanding of neural nets. And we only really had one data point at the time, which was the Fan games. Couldn't even really draw a line without knowing a lot about the field.
- yazr 7y agoMy only nitpick is that AG (ML + search really) improved logarithmic-ally with exponential compute. In addition, real world domains may not be some parallizable. So yes, current AI is like a brilliant intern. It will eventually be your manager, but its gonna take a few more years ?
- okareaman 7y agoI'm assuming you don't know anything about the extremely surprising, deeply emotional and spiritual experience it was for everyone involved or you wouldn't be asking this and just watch it with fascination.
- aquarin 7y agoUnexpectedly emotional. Movie about how people feel when meeting the new technology, not about the computers.
- dntbnmpls 7y agoI don't know much about Go and my interest with Alpha is primarily with chess (alphazero). But I watched it on Netflix anyways a while back and enjoyed it. It's an interesting behind the scenes look at the lead up to the match, the match itself and the fallout. Definitely worth a watch. If you want to see alphazero games, there are a bunch of analysis of alphazero and stockfish games on youtube as well.
- nmstoker 7y agoI'd echo this. It's the same as the version on Netflix. It's not a technical deep dive (but then again, that's rare in any documentary - even the General Magic documentary didn't go into the technical aspects really). It's a human interest piece with lots of the context and interviews with key people. Obviously tastes will vary but I would recommend it to the typical HN reader.
- jasode 7y agoIt's a "human interest" type of documentary which means it's deliberately structured as an "emotional narrative". I think it's fair to say that a lot of "no-nonsense-just-give-me-the-facts" viewers in the HN demographic would find this type of film very unsatisfying. I.e. lots of interviews with virtually no technical explanations. I quickly scrubbed the film and it looks like it's the same footage from the AlphaGo documentary I saw ~2 years ago: https://www.imdb.com/title/tt6700846/ https://www.imdb.com/title/tt6700846/ I don't know if this new video url dated "2020" is a different film or if they simply enhanced the 2017 documentary with new footage.
- okareaman 7y ago> a lot of "no-nonsense-just-give-me-the-facts" viewers in the HN demographic would find this type of film very unsatisfying I disagree with this assertion. The film explores the idea that AlphaGo, like the game of Go itself, raises a lot of questions about what it means to be human. The relationship between AI and humans is developing and a topic of intense interest, especially among the HN crowd. I think what you might be saying is people with a high IQ but low EQ might not relate to this film. I'm sitting here wondering if people like that don't find human/AI intersection interesting because they are already mostly like a computer program themselves so it's not a big deal.
- jasode 7y ago>, raises a lot of questions about what it means to be human. The relationship between AI and humans is developing and a topic of intense interest, especially among the HN crowd. We're talking about 2 different things: the importance of the topic vs the the method of exposition. You're emphasizing the topic's importance. I'm not disagreeing with that. Instead, I'm explaining that the documentary's style of exposition would be a turnoff to a subset of the HN demographic. As example showing differences in how Battle of Midway can be explained... Here's the "personality-driven" type of history documentary. Scrub the video and you'll see there's a lot of video showing the narrators walking around the beach and flying in helicopters: https://www.youtube.com/watch?v=wo9wrUcb8jI https://www.youtube.com/watch?v=wo9wrUcb8jI To be fair, some viewers need attractive people talking to the camera to make history "interesting". What does an attractive man walking along the beach have to do with explaining strategy and tactics at Midway?!? Nothing. Maybe some viewers need "eye candy" to go along with their medicine of history. Basically, all of The History Channel is structured as personality-driven type of documentaries with a human-interest angle. Compare that to another style of delivery with no video of talking heads but has a voice-over with maps and higher information content: https://www.youtube.com/watch?v=Bd8_vO5zrjo https://www.youtube.com/watch?v=Bd8_vO5zrjo If HN viewers want the 2nd style of documentary for AlphaGo, this thread's url is not it. The importance of "what it means to be human" is orthogonal to the method of explanation.
- Rerarom 7y agoSaw it on netflix last year. Good that it's public now
- 29athrowaway 7y ago[2017]
- akvadrako 7y agoDoes anyone know how the go world has been evolving since AlphaGo? I wonder if people are looking for weaknesses or perhaps just ways to contribute, so that a human + AI could beat an AI playing alone.
- roenxi 7y agoOpenings have standardised around the patterns that the AI systems have converged on, and people are practicing against neural networks/using neural networks to review their games. That is probably increasing the standard of play but it is difficult to measure.
- arvinsim 7y agoEven though I am not a Go player, it is concerning. This because now money comes into play rather than just raw skill. Picture a brilliant but poor player. How would that person fare against someone who has a good AI to practice against?
- ALittleLight 7y agoPicture a brilliant but poor person who doesn't have the time to dedicate to the game because they must deal with the constraints of being poor. Buying high end computer hardware is very cheap relative to the time required to become very good at go. Conversely, having a reasonably strong go program available on your mobile will mean there's more access to people to play and get analysis. I would expect that AI makes it better for poor people. Previously, a non-poor person might take classes or have a tutor. Now, a poor person can have an AI analysis of each of their games if they want.
- blueboo 7y agoHuman+AI play was forecasted to be the next big thing, but has proven to be a mere curiosity. After all, imagine a sitting down next to a grandmaster who helps you play your moves. Every move comes down to: Do you want to play the best move? y/N Indeed, the moves that a human would've overruled in the Lee Sedol tournament are the ones that vaulted AlphaGo to victory.
- brilee 7y agoSome updates on Computer/Human interaction from a Go AI author. Opinions are my own. In the Go world, the relationship between computer and human has turned into one of analysis. Every pro in Asia has a powerful GPU-equipped system with LeelaZero or KataGo or Minigo installed, and they use it to study openings and analyze their matches. LZ/MG are similar in that they're from the AlphaGoZero generation of bots, and thus are hardcoded to 7.5 komi and don't play well with handicap stones. KataGo is the open-source project with the newest ideas, using (among other things) territory ownership prediction, allowing it to handle arbitrary komi and handicap. Many pros are switching to it for this reason. All TV broadcast channels use AI for both winrate prediction and variation analysis. They'll report the predicted winrates by all major bots. There are definitely AI-inspired opening sequences, but I would say that by and large, pro play has stabilized to just be better. A few years ago, pros would just mimic AlphaGo just to see what would happen, but there's becoming a better appreciation for the many different opening styles that are becoming possible, now that we have AI to analyze them. The strongest pros are the ones who spend the most time on their computers. Despite a few extra years of research, all available AI systems still fail at ladders regularly. Some may have had ladder routines hardcoded in, but these routines still fail at loose ladders and the many wonderful ladder variants out there. In the online Go world, cheating has become rampant. Top echelon of games/accounts are essentially just people competing on how beefy their GPUs are, and human professionals complain that they can't actually get a game against another person nowadays. Professional tournaments / pro qualifying exams have had isolated incidents of cheating which are usually fairly obvious, as human playstyle is still recognizably different from computer playstyle.
- bo1024 7y agoThanks! Very informative.
- shmageggy 7y agoThis basically describes modern chess. Top pros use ultra-deep computers to find opening novelties. Some isolated incidents of cheating in real tournaments. There is some cheating online still, but the novelty wore off long ago so it's not endemic, plus most only play fast time controls online because it's much harder to cheat.
- viig99 7y agoLee sedol is a pretty cool guy and a normal human being, albeit the crazy ability to remember games likes maps, do watch the latest episode of 'master in the house' a korean variety show which featured lee sedol as the guest.
- ipnon 7y agoI'm amazed that any 1 person can even compete with a team of dozens of Ph.Ds and teraflops upon teraflops of processing at all.
- joeblau 7y ago[SPOILERS] To me there are five super interesting points in this video. 1. The arrogance/confidence that people had towards AlphaGo assuming that it was not going to be competitive. 2. The lack of understanding tt even the programmers had for the game. At one point the devs were saying "I don't even know if that's a good move or not", yet their program is playing at superhuman play. 3. The amazement that commentators and other players experienced when AlphaGo performed move 37 in game 2. 4. The disappointment experienced by everyone when they came to the realization after game 3 the computer won. 5. The confusion when the computers neural network fails in game 4 and everyone (except the engineering team who sees the probabilities) is confused about whether the machines play is brilliant or terrible.
- esjeon 7y agoJust random thoughts: > 1. The arrogance/confidence that people had towards AlphaGo assuming that it was not going to be competitive. This is pure stupidity. Those people didn't realize the nature of the game. Go is a (large) confined space, which, by nature, can be brute-forced for the best answer. ML was needed simply to trim and optimize search tree, to find the best local maxima from a broader range (than other AIs). > 2. The lack of understanding tt even the programmers had for the game. At one point the devs were saying "I don't even know if that's a good move or not", yet their program is playing at superhuman play. You can't even predict solutions from a simple DFS. Right things are not always obvious nor intuitive. > 5. The confusion when the computers neural network fails in game 4 and everyone (except the engineering team who sees the probabilities) is confused about whether the machines play is brilliant or terrible. It's likely that AlphaGo didn't look beyond "horizon"[1], and only realized it's losing after a dozen moves. In this sense, move 78 in game 4 itself is more amazing than move 37 in game 2. The only reason why the latter is uncommon is it's believed that it's difficult to build house in the sky(middle), thus one should keep stones close to ground(border), but that naturally depends on the situation. [1]: https://en.wikipedia.org/wiki/Horizon_effect https://en.wikipedia.org/wiki/Horizon_effect
- tobr 7y agoI watched the entire thing, but I know close to nothing about Go. I found it frustrating that they didn’t attempt to explain what was so unexpected about some of the specific moves, but just focused on everyone’s reactions to them. Is there somewhere I could read a beginner-friendly explanation of what was so significant about the moves, and how and why they changed the games?