2 ms·
> I don't get why deep learning researchers are so hung up on learning everything from scratch. It's a better approach if we want to develop generalisable lear
by MaxBarraclough 9y ago
> I don't get why deep learning researchers are so hung up on learning everything from scratch.
It's a better approach if we want to develop generalisable learning systems, no?
- YeGoblynQueenne 9y agoIn theory, perhaps- in practice it's not feasible. I was having a similar conversation today with my thesis supervisor and he quoted something Turing had said in his original machine intelligence paper, that "There's not enough information in data to learn from nothing". This was in the context of machine learning, because Turing was wondering about the best way to create a learning machine. I think the bottom line is that he didn't think you could do it without some background knowledge, of some sort. Edit: I haven't read Turing's paper recently and I might be misquoting him, but I do think that was his general intuition, that you can't just learn the world by observing the world.
- MaxBarraclough 9y ago> There's not enough information in data to learn from nothing Given that AlphaZero just happened, we now know that isn't true, no?
- posterboy 9y agoThe alphazero paper mentions that go has especially simple rules and that chess and shogi are more complicated. But the rules are still pretty clear. To some extend, they must have at least hard coded in the training data who won a particular game; or the game rules have to be hard coded. Something has to be hard coded. That is far from "nothing" prior! But the paper is cryptic to me, overall ("Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm"). Also, the parent comment is paradox. Data is information and that is something, so learning from data is learning from something.
- YeGoblynQueenne 9y agoIf I remember correctly, in the "Mastering Chess etc" paper the structure of the neural net was mapped onto the chess board itself. The movement range of different pieces was also hard-coded into the network architecture -for example, there was a vector encoding "queen moves" and another for "knight moves" which taken together cover all possible chess piece moves. The encoding of the moves was not used to generate moves, per se- I don't remember the details very well but that was a separate module that I believe fed moves to the MCTS algorithm. The move range was encoded as a kind of constraint, to keep the network from exploring unproductive moves. So the network didn't have to learn anything about the rules of chess, shogi or go and indeed, it did not. That knowledge was given to it directly. As far as I know, this is the done thing with most game-playing systems, especially ones for classic board games that have usually very simple rules that are easy to hand-code (so that there's no real need to learn them from scratch). It would be interesting to see if it's possible to machine-learn the _rules_ of a game (i.e. given a move, recognise it as legal or not). A quick scan of internet search results confirms my recollection that most published work in game-playing agents focuses on learning how to play well, rather than how to play in the first place (indeed "learning to play chess" is used to mean "learning to win" in many publications).
- ArneBab 9y agoInformation is data with interpretation. That’s the learning hierarchy: data -> information -> knowledge -> wisdom
- YeGoblynQueenne 9y agoWell, AlphaZero doesn't use expert knowledge of Go, specifically, but it still uses Monte Carlo Tree Search, which is a very strong encoding of what matters in games in general, so I'd say, no. It's not learning from nothing.
- MaxBarraclough 9y agoWell it's a specific algorithm, sure. If that's enough to dismiss it as 'not learning from nothing', then nothing could ever qualify as learning from nothing. Learning from nothing != general AI.
- ArneBab 9y agoLearning from nothing would mean that you do not encode when someone won, and also not which moves are legal.