> the fact that simple rulesets yield complex behavior that is hard to predict and/or derive using all kinds of models I don't think this is the paper's "findi

> the fact that simple rulesets yield complex behavior that is hard to predict and/or derive using all kinds of models I don't think this is the paper's "finding" at all. Sure, the Game of Life indicates that simple systems can result in complex, emergent behavior. But, exactly for being a simple set of rules, it is trivial to create a Game of Life implementation (or following this paper's definition, to solve the problem of predicting the nth next state, given the current state). The findings are rather that neural networks, despite its universality and prediction power, have a hard time learning parameters that solve this trivial task using a minimal architecture, so they require a larger amount of parameters or a very good initial set of weights ("lottery ticket").