5 ms·
Cellular Automata as Convolutional Neural Networks
- yodon 6y ago> We show that any CA may readily be represented using a convolutional neural network with a network-in-network architecture.
- hardmath123 6y agoSee also: "learning" Conway's Game of Life configurations by gradient descent. https://hardmath123.github.io/conways-gradient.html https://hardmath123.github.io/conways-gradient.html
- montebicyclelo 6y agoExcellent write up. I've coincidentally been experimenting with the same thing. Any idea whether this approach could be used to speed up a search for exact solutions?
- dumb1224 6y agoI wonder if it is because using backpropagation all non-linear functions are chained together when the weights are learnt? Is it naive to think by that formulation the results will be quite similar since the final model equations are close?
- seventytwo 6y agoNot sure I understand the importance of this...
- juskrey 6y agoIndeed, CA can be represented by simple combinations of boolean functions, obviously by NN also, which is a combination of similar nonlinear functions.
- benibraz 6y agoA wide enough NN can represent any arbitrary binary function, but it's not obvious that one can learn it.
- labelbias 6y agoYet the best NNs are deep, not wide.
- benibraz 6y agoWhat do you mean by 'the best'? Deeper architectures are popular because they quiet easy to train. They do work well in practice on many tasks (especially vision) but they have their limits. Infinite wide networks are a newly active field and has recently shown some promising results, theoretically [1, 2] and empirically [3]. [1] https://arxiv.org/abs/2001.06931 https://arxiv.org/abs/2001.06931 [3] https://arxiv.org/abs/1806.07572 https://arxiv.org/abs/1806.07572 [2] https://ai.googleblog.com/2020/03/fast-and-easy-infinitely-wide-networks.html https://ai.googleblog.com/2020/03/fast-and-easy-infinitely-w...
- mysterEFrank 6y agokind of obvious
- wadkar 6y agoCan you please tell us how is it obvious? I am interested in the network in network part
- marcAKAmarc 6y agoI was hoping to see some mention of rule 110
- yummypaint 6y agoI take it this is not a bidirectional mapping?
- nuclearsugar 6y agoNow just use the OTCA Metapixel, build a computer within the simulation, and let it go wild! http://www.amandaghassaei.com/blog/2020/05/01/the-recursive-universe/ http://www.amandaghassaei.com/blog/2020/05/01/the-recursive-... https://codegolf.stackexchange.com/questions/11880/build-a-working-game-of-tetris-in-conways-game-of-life https://codegolf.stackexchange.com/questions/11880/build-a-w... https://github.com/QuestForTetris https://github.com/QuestForTetris