9 ms·
This is a great advancement, and will be even more so if you can beat Lee Sedol. There are two interesting areas in computer game playing that I have not seem
by tzs 11y ago
This is a great advancement, and will be even more so if you can beat Lee Sedol.
There are two interesting areas in computer game playing that I have not seem much research on. I'm curious if your group or anyone you know have looked into either of these.
1. How to play well at a level below full strength. In chess, for instance, it is no fun for most humans to play Stockfish or Komodo (the two strongest chess programs), because those programs will completely stomp them. It is most fun for a human to play someone around their own level. Most chess programs intended for playing (as opposed to just for analysis) let you set what level you want to play, but the results feel unnatural.
What I mean by unnatural is that when a human who is around, say, a 1800 USCF rating asks a program to play at such a level, what typically happens is that the program plays most moves as if it were a super-GM, with a few terrible moves tossed in. A real 1800 will be more steady. He won't make any super-GM moves, but also won't make a lot of terrible moves.
2. How to explain to humans why a move is good. When I have Stockfish analyze a chess game, it can tell me that one move is better than another, but I often cannot figure out why. For instance, suppose it says that I should trade a knight for an enemy bishop. A human GM who tells me that is the right move would be able to tell me that it is because that leaves me with the two bishops, and tell me that because of the pawn structure we have in this specific game they will be very strong, and knights not so much. The GM could put it all in terms of various strategic considerations and goals, and from him I could learn things that let me figure out in the future such moves on my own.
All Stockfish tells me is that it looked freaking far into the future and it makes any other move the opponent can force it into lines that won't come out as well. That gives me no insight into why that is better. With a lot of experimenting, trying out alternative lines and ideas against Stockfish, you can sometimes tease out what the strategic considerations and features of the position are that make it so that is the right move.
- Cyph0n 11y agoThe first point is a good one. As for the second point, I think that will be achieved only when we're close to realizing a general AI.
- jegutman 11y agoThis is actually a problem I've given a decent amount of though on (although not necessarily reaching a good conclusion), but I think these problems are actually related and not impossible for this simple case. It comes to an issue of what parts of the analysis and at what depth did a best move come to vision? Was it bad when it was sorted for 8 ply but good at 16? Maybe that won't "tell" a person why a move was good, but it gives a lot of tools to help try to understand them (which can be exceedingly difficult right now if a line is not part of the principal variation, but ultimately affects the evaluation by an existing "refutation". But I think the other "difficulty" is that 1800 players play badly in lots of different ways, 2200s play badly in lots of different ways and even Grandmasters play badly in lots of different ways, but very strong chess engines play badly only in a few sometimes limited ways.
- optimiz3 11y agoIt's a bit of a game design problem too, since you may want to optimize for how "fun" the AI is to play against. There are patterns of behavior that can be equivalently challenging, but greatly varying in terms of how interesting or enjoyable they are to play against. I.e. there are various chess bots that can be assigned personality dimensions like aggressiveness, novelty, etc.
- frandroid 11y ago30 years from now, right?
- sheeshkebab 11y ago20.
- gohrt 11y agoA general AI will likely be LESS able to explain why a move is good, for exactly reason mentioned above (post-rationalization of a massive statistical computation)
- 11y ago
- ohitsdom 11y agoFor point #2, the current state of AI allows only for "because you're more likely to win with this move." Today's AI can't reason like a human mind does, it just simulates thousands of scenarios and analyzes which are more likely to be successful, with a very primitive understanding as to why.
- taurath 11y agoWouldn't it be possible to compare the "top" move with the "runner up" move, compare outcome percentages, and declare whether there is a small or large deviation? Or comparing the "top" move with any other possible move? Or is that too much calculation?
- umanwizard 11y agoWell, you can make chess engines give you a numeric evaluation for several possible moves. These are typically tuned so that the value of a pawn is around 1 point. A grandmaster 1 or 2 points ahead can routinely convert to a won game, assuming he doesn't blunder. So if the best move has an evaluation of +0.05 and the second best has -0.02 , the difference is probably a very subtle positional improvement (and the first move may not in fact be better; chess programs aren't perfect). If the best is +3.12 and the second is -0.02, and you can't see why, there's a concrete material tactic you're missing (or, less likely, a major, obvious positional devastation). But, it can't tell you what you're missing, just the magnitude of the difference.
- jibalt 11y agoCompare all you want ... that doesn't tell you why the choice was made, because it was made by evaluating and comparing many millions of positions.
- sfsylvester 11y ago> "because you're more likely to win with this move" Is that not exactly how a human decides which move to play?
- 11y ago
- beefman 11y ago#1 is a solved problem. Ken Regan tells us how to do it. To my knowledge, no commercial chess app has implemented it yet.
- zodiac 11y agoCan you provide some links to where Ken Regan describes how to do it?
- beefman 11y agoYou just run multi-PV analysis and play moves to keep the intrinsic performance rating[1][2] at the desired level. [1] http://www.cse.buffalo.edu/~regan/papers/pdf/ReHa11c.pdf http://www.cse.buffalo.edu/~regan/papers/pdf/ReHa11c.pdf [2] http://www.cse.buffalo.edu/~regan/papers/pdf/Reg12IPRs.pdf http://www.cse.buffalo.edu/~regan/papers/pdf/Reg12IPRs.pdf
- sanderjd 11y agoThanks for the awesome links! > You just run multi-PV analysis and play moves to keep the intrinsic performance rating at the desired level. I thought that "just" was funny – it reminds me of this comic[0]. [0]: http://howfuckedismydatabase.com/nosql/fault-tolerance.png http://howfuckedismydatabase.com/nosql/fault-tolerance.png
- beefman 11y agoIt just means analyzing more than one move at a time. Any engine supporting the UCI protocol should be able to do it. Like Stockfish, which is free.[1] So you don't need to create a new engine to implement this feature. It might be possible to implement it with a bash script. Certainly with JS.[2] Stockfish does have a "skill level" setting, and it's not terrible at faking club-level play (if you have the Play Magnus mobile app, it's just Stockfish at different skill levels). However, as of 2013 the implementation is much more primitive than what I'm suggesting here.[3] To be clear, even though it's incredibly obvious, I've never seen this idea anywhere else. It first occurred to me after reading the original Guid & Bratko paper on intrinsic ratings in 2006. Happy to continue this offlist if you want to work on it. My e-mail is in my profile. [1] http://support.stockfishchess.org/kb/advanced-topics/uci-protocol http://support.stockfishchess.org/kb/advanced-topics/uci-pro... [2] https://www.npmjs.com/package/stockfish https://www.npmjs.com/package/stockfish [3] https://groups.google.com/forum/#!msg/fishcooking/4Q6BQyHeRJQ/eu63qkOyWUkJ https://groups.google.com/forum/#!msg/fishcooking/4Q6BQyHeRJ...
- jameshart 11y agoFor your second question, of course, a grandmaster can only tell you why they think they made the move. It may be a postrationalization for the fact that they feel, based on deep learning they have acquired over years of practice, that that move is the right one to make. It doesn't seem too difficult to have an AI let you know which other strong moves it rejected, and to dig into its forecasts for how those moves play out compared to the chosen move to tell you why it makes particular scenarios more likely. But that would just be postrationalization too...
- meric 11y agoPerhaps postrationalizaton is still useful? Could empathy and mirror neurons help transfer some of that deep learning? Two weeks later the student faces a similar situation, and they get the same gut feeling their teacher did, and that helps them play better than if their teacher didn't postrationalize?
- jameshart 11y agoAbsolutely! My point is that human intelligence doesn't actually have any deep insight into how it makes decisions, so we shouldn't be that disappointed that an AI doesn't, either. Humans can postrationalize - explore how they think they make decisions - but they can't tell you how they actually decided. Doing the same for an AI is interesting, but I don't think it's a necessary component of making good decisions in the first place to be able to explain why you made it.
- cgio 11y agoOn the other hand, not all actions are decisions. There is plenty of actions we would classify as decisions which are application of rules instead. There is a clear rational path in application of rules. To clarify terminology, for me decisions are actions in response to intractable computationally challenges, e.g. will that couch fit in my living room (when I am in a store, where size calculations are hard in an unfamiliar context) etc. This could mean that your action is my decision if we are not equally capable of calculating based on rules.
- unclebucknasty 11y agoFor #2, is Stockfish implicitly discovering things that a human might explicitly recognize and articulate (e.g. that the pawn structure has an outsized impact on the value of certain pieces)? If so, could it be just as easily programmed to answer those questions as it evaluates moves? That is, it seems the information is there to form those answers, but it's not the question the AI has been asked.
- TylerE 11y agoI rather doubt it. Historically there has been a back-and-forth with chess engines.... Early engines tried to really "smart", but consequently couldn't really analyze very deeply, as they spent a lot of time on each position. Newer engines mostly churn through really deep analysis, going many layers deep, but are making comparatively simplistic analyses.
- unclebucknasty 11y agoI guess I am asking whether it's valid to criticize the AI for not answering questions that it wasn't asked. For instance, it wasn't asked to evaluate the pawn structure and provide that analysis as an output, but it certainly could be programmed to do so.
- jibalt 11y ago"For instance, it wasn't asked to evaluate the pawn structure and provide that analysis as an output, but it certainly could be programmed to do so." This quite misses the point. These programs do that as a matter of course, for individual positions. But choosing a move is the result of evaluating many millions of positions and comparing the scores through tree pruning. The program cannot tell you that it chose one move over another because the chosen move is generally better for the pawn structure than the move not chosen, because it doesn't have that information and cannot obtain it.
- unclebucknasty 11y ago
- malkia 11y agoThis reminds me something I've read long time ago about the Heroes of Might and Magic game. At some point the AI was so good, it wasn't fun to play, and it had to be dumbed down.
- jtolmar 11y agoThis is a frequent pitfall in video game AI - people go into it thinking the AI's goal is to win, then learn the hard way that the AI's goal should be to lose in an interesting way. Nobody says that the red koopa in Super Mario Bros. has bad AI.
- kbart 11y agoDo you have any references? I HoMM (3) is my all time favorite game and I'd love to have better AI.
- malkia 11y agoI can't remember, but I do think it was an interview with Jon Van Caneghem... Either in a book of game design, or magazine. I have to find it. Similarly long time ago, read about how AOE (Age of Empires) used a lot of computers to play against each other, then do statistic which units actually got used. The idea was to rebalance the units such that all are almost equally used (well in terms of computer-ai play). I think these two articles were both in the same book, so I'll have to dig. HOMM3 is also my favourite game, along with Disciples. I'm a big turn-based strategy fan :)
- rangibaby 11y ago> 1. How to play well at a level below full strength. In chess, for instance, it is no fun for most humans to play Stockfish or Komodo (the two strongest chess programs), because those programs will completely stomp them. It is most fun for a human to play someone around their own level. Most chess programs intended for playing (as opposed to just for analysis) let you set what level you want to play, but the results feel unnatural. The astronauts in 2001 play chess with the computer, and it sometimes loses on purpose to make the game more interesting for them.
- jibalt 11y agoThat's exactly what tzs said they don't want.
- kriro 11y agoBoth points are excellent. I think the second one is more important immediately. If you look at the "expert systems" literature, specifically older expert systems based on logic programming, there usually was an "explanation component" in the general architecture. However I think this area has been under-researched but is obviously important. It would enable very strong learning environments and man/computer hybrid systems. I think there's very direct relevance in safety/security critical systems and there's some literature in operators not understanding what is going on in complex systems and how that can be fatal (think power plants and the like)
- reacweb 11y agoThe level of a player is generally the level of its worst moves. Even a beginner makes some super-GM moves sometimes (by mistakes).
- jibalt 11y agoChess level cannot be determined by the strength of individual moves.