6 ms·
Actually this AI kind of confirms these myths, since its basis are not in mathematics but in neural networks. While it could be argued to be just math, so is th
by hasenj 11y ago
Actually this AI kind of confirms these myths, since its basis are not in mathematics but in neural networks. While it could be argued to be just math, so is the brain, but that's besides the point. The point is, even the programmers have no idea what the AI is thinking.
The way it picks moves is very similar to how top professionals do.
Intuition is reduced to memories stored vaguely as neural connections.
- irascible 11y agoStored discretely and permanently you mean..
- hasenj 11y agoI mean it's not clear in anyway "where" is the intuition, it just sort of magically emerges from the connections and the weights in a way that no one can really grasp. If nothing else, just due to the sheer number of neurones.
- MichaelBurge 11y agoIs this just something you're imagining, or did Google's developers explicitly say, "AlphaGo is beyond our understanding. We have absolutely no idea how it makes its decisions"?
- hasenj 11y agoI'm pretty sure I heard them say this. They can see certain stats and high level overview. But they have no idea what it's thinking. They know the general pattern of the algorithm. They even explain it. But the algorithm involves two deep neural networks, and they don't really know what's going on inside them. One of the developers showed up during the commentary on the second game and talk about this stuff: https://youtu.be/l-GsfyVCBu0?t=2519 https://youtu.be/l-GsfyVCBu0?t=2519
- cLeEOGPw 11y agoAlphaGo developers don't understand how it works in the same way you wouldn't understand how the program you've written to find prime numbers actually found a big prime number. The sequence of operations is known, but numbers are too big to be comprehended.
- goldenkey 11y agoWhich kind of makes me think. Would machine learning succeed even mildly at recognizing primes? Would we be able to decode the final weights after weeks of learning, and find a sieve program encoded as data? Well apparently my question leads to some deep mathematic theories about languages encoded by data. http://cstheory.stackexchange.com/questions/15039/why-can-machine-learning-not-recognize-prime-numbers http://cstheory.stackexchange.com/questions/15039/why-can-ma...
- hughperkins 11y agoI think its more like, real parents dont understand why their children do the bizarre things that they do.
- cLeEOGPw 11y agoI don't think so.
- argonaut 11y agoI fear this is an overly mystical misinterpretation of neural nets. (Standard feed-forward) neural nets are layers of non-linear feature transformations. They take inputs and at each step transform those inputs into a more compact representation, distilling the inputs into their most important factors (and throwing away unimportant factors). So the most likely explanation is that policy/value nets in AlphaGo have learned to extract - with cold logic - the key factors that make up what humans believe to be "good" board positions. It has little to do with voodoo about neural connections and magic emerging from the weights. AlphaGo has most likely managed to identify the important factors of good board positions (by seeing tons of examples of good and bad moves/positions). It only appears to be magical because these factors are most likely very complex and inter-dependent. This is supported by the AlphaGo paper - they report that AlphaGo without tree search is about as good as the best tree search programs (amateur pro level). So AlphaGo has taken amateur-pro-level board analysis ability, and combined it with tree search, to achieve top-player performance..
- versteegen 11y ago> So AlphaGo has taken amateur-pro-level board analysis ability, and combined it with tree search I don't think that's an entirely accurate way of putting it, because a player who reaches that level is also doing a little tree searching. Maybe if you found some human who managed to reach "amateur pro" level by playing purely on snap, instinctual decisions without any logic or exploration of variants at all, yes, then you could say their ability to evaluate positions is as good as AlphaGo's. But I would guess that you are right anyway that we can deduce that its ability to evaluate a board position really is below that of better professionals, and its huge strength is due to the tree search (which of course involves a second "policy" net to pick moves to explore).
- reacweb 11y agoIn go, the tree searching is named "reading". Even beginners need to read very deep trees (more than 7 moves) to anticipate the result of a Semeai (capturing race).
- Veedrac 11y ago
- wyager 11y agoYou can still beat Go using "simpler" math. If you have enough compute power, you can always just minimax the whole game tree. Neural networks aren't un-mathematical; they're just a slightly more complicated technique for discovering an approximation to a function that does what you want (even if you're not sure what that function looks like internally).
- blacksmith_tb 11y agoSo AlphaGo's reign will last only until QuantumGo arrives on the scene? It would be sort of ironic to have spent decades developing practical AIs with classical computing to have them swept aside only when they started to really deliver results...