12 ms·
Evolution Is the New Deep Learning
- peterstoziek 9y agoAs expected, the article seems to be a typical content marketing piece. If you're looking for real insights into evolutionary algorithms, specifically "neuroevolution", I highly recommend to read this article: https://www.oreilly.com/ideas/neuroevolution-a-different-kind-of-deep-learning https://www.oreilly.com/ideas/neuroevolution-a-different-kin... I enjoyed it much more than - what feels like - a quickly thrown together marketing piece with no real value for the reader.
- vanderZwan 9y agoThank you, saved it for later. Do you have any other links to offer?
- peterstoziek 9y agoUnfortunately not in this domain.
- ericjang 9y agoHere's a recent survey / observational science paper by some prominent "neuroevolution" / A-Life researchers. https://arxiv.org/abs/1803.03453 https://arxiv.org/abs/1803.03453. I found this refreshing because it's rare that science papers talk about the debugging and experimental process and debugging journeys underlying this research.
- ofrancon 9y agoA few links you can look at if you're interested in neuroevolution, from the same group of researchers: Ken Stanley and Risto Miikkulainen original NEAT (NeuroEvolution of Augmenting Topologies) paper: http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf Ken Stanley's novelty search page, and a link to his book, "Why Greatness Cannot Be Planned: The Myth of the Objective": http://eplex.cs.ucf.edu/noveltysearch/userspage/ http://eplex.cs.ucf.edu/noveltysearch/userspage/ Risto Miikkulainen's Evolving Deep Neural Networks paper: https://arxiv.org/abs/1703.00548 https://arxiv.org/abs/1703.00548 Ken Stanley & team's work at Uber, with links to some recent papers: https://eng.uber.com/deep-neuroevolution/ https://eng.uber.com/deep-neuroevolution/
- yazr 9y agoAre these evolutionary techniques considered more or less sample-efficient (and or cpu-efficient) compared to DL with GD ??
- jamesblonde 9y agoNot quite a typical piece - it managed to make it to #2 on HN.
- John_KZ 9y agoI upvote links that promote discussion of interesting concepts, even if the article itself is really bad - like this one. I couldn't bother reading the original article, but designing neural networks via evolutionary algorithms is a very interesting concept I wasn't aware of.
- deepnet 9y agoThanks for the great link surveying Evolution and NEAT ( Neuroevolution of Neural Nets ) by Ken Stanley who pioneered the method. The OP is by Risto Miikkulainen who was Stanley's collaborator on NEAT and should not be summarily dismissed.
- rpm13 9y agoNote that this blog post is not an article per se, but an overview of a research website (https://sentient.ai/sentient-labs/ea https://sentient.ai/sentient-labs/ea) built around five new research papers. The website offers demos that illustrate neuroevolution and evolutionary computation concepts at a much more concrete level than the papers can.
- rpm13 9y agoFor a short intro to neuroevolution there is http://www.scholarpedia.org/article/Neuroevolution http://www.scholarpedia.org/article/Neuroevolution However, these overview articles do not include the newest research on evolving deep learning networks. Three such papers are introduced at https://www.sentient.ai/sentient-labs/ea-1/; https://www.sentient.ai/sentient-labs/ea-1/; there are other recent ones at https://research.googleblog.com/2018/03/using-evolutionary-automl-to-discover.html https://research.googleblog.com/2018/03/using-evolutionary-a... and https://eng.uber.com/deep-neuroevolution/ https://eng.uber.com/deep-neuroevolution/. It is a rapidly developing area.
- raker 9y agoThis article explains very little about the actual technique. Digging into the paper, it seems like this has to do more with training a network with multiple data sources at the same time, to take advantage of related patterns across data sets. I'm not professionally versed in NNs myself, but what would be the closest equivalent to recreating this sort of training with tools available today? (in Keras or R for instance)
- XnoiVeX 9y agoA philosophical tangent: Evolution did not always produce the best outcomes. Would neuroevolution be vulnerable to similar effects? Probably a good research area. https://www.wired.com/2009/07/st-best-5/ https://www.wired.com/2009/07/st-best-5/
- glup 9y agoBiological evolution seem pretty susceptible to overfitting to ecological circumstances—I worry that there would be an analog for these techniques with NNs
- eafan 9y agoThere are well known problems that evolutionary systems are much better at solving than NNs. The multiplexer problem, for instance, or sorting networks, where the search space is too rugged or deceptive for neural network solutions.
- cvaidya1986 9y agoWhat’s the definition of best
- goatlover 9y ago350,000 species of beetles.
- TheOtherHobbes 9y agoIn music, evolution produced Bach, so it can't really be considered a failure. It took a while though, and it's possible alternative approaches would have been produced a similar result more efficiently.
- cvaidya1986 9y agoI love HN community. Awesome responses!
- boffinism 9y agoInteresting to see that we're a long way from this technique actually generating anything valuable. E.g. if you try the LSTM Music Maker they link to (https://www.sentient.ai/sentient-labs/ea/lstm-music/ https://www.sentient.ai/sentient-labs/ea/lstm-music/) and enter a melody, the resulting 'improvisation' will neither have any of the hallmarks of your initial input nor obey any of the conventions of any genre of music I recognise. It'll just spew out a random-seeming spray of notes. Compared to, say, JukeDeck (https://www.jukedeck.com/make/track-generator/essential https://www.jukedeck.com/make/track-generator/essential), which uses bog-standard AI, it's got a long way to go.
- TheOtherHobbes 9y agoEvolutionary approaches won't necessarily produce better music. This is a well-researched area. The challenge with all GA work is finding the right fitness function. If you don't understand your domain well enough to define a good fitness function you're going to be wasting your time, and no amount of algorithmic and/or AI magic is going to help you.
- maksimum 9y agoI think the point here is that we don't need to define a fitness function for "good music", but a fitness function for e.g. "reconstruction error" for auto-encoders. While the latter is still challenging, it seems slightly easier, although I'm not sure that it's significantly easier than general manifold learning...
- monistowl 9y agoThis is how we all wind up in a Peter Watts novel. http://www.rifters.com/real/MAELSTROM.htm#breeder http://www.rifters.com/real/MAELSTROM.htm#breeder
- mav3r1ck 9y agoHaving studied this extensively back when they were called Genetic Algorithms, I would like to offer a few insights. 1) One of the biggest reasons they fell out of favor for more "mathematical" approaches was that no one could really explain why exactly they worked. It makes sense on the surface that "survival of the fittest" and doing something akin to multiple stochastic gradient descents would work, but no one has really been able to produce a mathematical proof as to why. Since other folks are producing good examples of "explainable AI", I don't know how Genetic Algorithms/programming could be made 'explainable' as to why they achieved an optimal solution other than hand-waving to how evolution works in nature. 2) The most important thing to define is the fitness function, this defines what the search space looks like and how easily a globally optimal solution can be derived. For a good example of an interesting search space that a genetic program would have a difficult time with, see Schwefel functions [0]. Back when I researched these things closely, my intuition was that reality rarely fits neatly into good fitness functions and I felt that at the point you are understanding the problem, you may just be better off with a direct approach, which leads to 3) Genetic programming should only really be considered when there are no known alternatives or they are way too computationally expensive. In either case, I would welcome a resurgence in a topic I once knew quite well, though I haven't been in that field for a few years now. [0] https://jamesmccaffrey.files.wordpress.com/2011/12/schwefelsfunction.jpg https://jamesmccaffrey.files.wordpress.com/2011/12/schwefels...
- azakai 9y agoRegarding 1, that seems surprising: biology has had many mathematical proofs and models (for almost a century now, e.g. Fisher) explaining why evolution works. Evolution works in nature for non-hand-wavey reasons, doesn't the same logic justify artificial evolution in genetic algorithms?
- ewjordan 9y agoWait, I'm confused...you're saying genetic approaches fell out of favor because they're basically just stochastic gradient descent? Most of modern DL relies heavily on SGD at various points during training. My impression is that they fell out of favor precisely because don't actually use any gradients, and end up converging on good maxima slower than you could if you used the gradients from the net. Am I off base here?
- rdlecler1 9y agoThe problem is in the genotype-phenotype map and getting that right. We should be looking at developmental evolutionary neural networks. That is, evolutionary algorithms evolving the genetic architecture (genotype) that generates (development) neural networks (phenotype).
- chrisfosterelli 9y agoThese "evolved neurons" look ridiculously more complicated and expensive to evaluate than a base neuron for a minor improvement in performance. The Music Maker paper mentioned that LSTMs haven't changed in "25 years", but didn't mention the 2014 Gated Recurrent Units that have become so popular specifically because they are much more simple to understand and evaluate. This approach seems to be going in the opposite direction. I guess the idea of them being evolved is that you don't _need_ to understand them, but evaluation performance is definitely a concern and doesn't seem to be addressed much. Interesting early work though!
- verdverm 9y agoLikely solution bloat, another of the EC/GP oddities that arise. During reproduction you randomly disrupt solutions, so to protect good solutions from being disrupted, the solutions increasingly add irrelevant stuff. This drops the probability that the good part gets messed up, but leads to loss of population diversity, as there are an infinite num er of useless things you can add /d o
- azinman2 9y agoEverything old is new again
- fnbr 9y agoI think this is true, broadly. Biological evolution has a large advantage in that it introduces a large amount of exogenous variation into the system (it just randomly changes DNA via a number of ways, and selects the "best" changes). This can be good as it allows you to do a lot more exploration than with a comparable gradient based approach, as the gradient based approach can't explore entirely new parameters; it can only look at parameters that have already been shown to be good. This is why, for instance, dead neurons are a problem with ReLUs. I don't think (but have not proof) that this would be a problem with evolution. I think that evolutionary approaches are a lot better at the exploration phase, but weak at exploitation; gradient methods tend to be the opposite. I think some sort of combination of the two, like Max Jaderberg's "Population based training of neural networks" [1], is the way to go. [1]: https://deepmind.com/blog/population-based-training-neural-networks/ https://deepmind.com/blog/population-based-training-neural-n...
- m3kw9 9y agoGradient descent is already a type of evolution that converges to a truth
- badloginagain 9y ago"In this Omniglot multitask character recognition task, our research team improved error of character matching from 32% to 10%" Death to CAPTCHA
- billconan 9y agothe music generation demo isn't really impressive to me. the outputs were pretty random.
- CretinDesAlpes 9y agoYes, this is really bad, not sure what they want to show. "The AI is processing your melody...", sure, but it can be processed without AI and you could get a much better output. At least please keep the output notes on the same input scale...
- nathan_f77 9y agoYeah this demo was not great. But I just found this article about AI-generated music, and it's actually very good: https://futurism.com/a-new-ai-can-write-music-as-well-as-a-human-composer/ https://futurism.com/a-new-ai-can-write-music-as-well-as-a-h...
- abrichr 9y agoCheck out Performance RNN: https://magenta.tensorflow.org/performance-rnn https://magenta.tensorflow.org/performance-rnn
- foobaw 9y agoI just tried their music maker (https://www.sentient.ai/sentient-labs/ea/lstm-music/ https://www.sentient.ai/sentient-labs/ea/lstm-music/). Was this ONLY trained by Bach Chorales? Everything sounds so fugue.
- IAmEveryone 9y agoIf only wishing made it so... Evolutionary approaches have always had one big feature in their favour: they are far more fun to work with. They produce all these fascinating oddities, like the one that learnt to outsmart it’s opponents at infinite tic-tac-toe by playing coordinates 102312 and 47875 and watching them run out of memory trying to build a data structure for the board. They are also far easier to combine with human expertise, i. e. “I can do this! Let’s throw some of my ideas into the gene pool”. But empirically it’s hard to deny that neural nets have been used for some incredible things over the last years. I think it’s the rare hype that is deserved.
- simion314 9y agoAs others mentioned the hard part is modeling your problem, how to encode the "individuals", defining a good fitness function etc. I think he neural networks are more poplar now because are easy to use, you throw data at it and you get some results(though IMO I am scared that we are using things that we do not understand exactly how they work)
- deleted 9y ago[deleted]
- maaaats 9y agoI used them for my thesis to make bicycle wheels [0], was fun to watch it making the simulation explode in order to obtain extreme values. Also recently held a workshop where we used EAs to make figures walk[1]. A lot of funny results at the end! [0]: https://news.ycombinator.com/item?id=10410813 https://news.ycombinator.com/item?id=10410813 [1]: https://github.com/Matsemann/walkingea https://github.com/Matsemann/walkingea
- make3 9y agoit's just not. Evolution learns more sloly than reinforcement learning, which itself learns much more slowly than supervised deep learning. Evolution doesn't have gradiants, and needs a huge amount of samples to learn anything.
- cshenton 9y agoActually, evolutionary strategies make use of either empirical or naturalised gradients on the search space.
- make3 9y agoI guess sexual reproduction is kind of like sharing gradients. Is that what you mean?
- cshenton 9y agoNot quite, genetic algorithms represent the search space usually as bit sequences, so you can just mix subsequences from two parents, that's reproduction. In contrast, evolution strategies have a search distribution, and compute a gradient update to that distribution from an entire generation. So it's really more 'search gradients' than evolution. The only thing 'evolutionary' about it is that the minibatches are called generations.
- baxtr 9y agoThis is funny. I did my master thesis back in 2003 using "genetic" algorithms. Maybe I should try to get funding for an AI startup
- hmm_really 9y agoI did a 1st year Uni project using GA to evolve neural network topology in 1996 ... maybe I should dig that out and get me some VC $.
- jnwatson 9y agoThat stuff is hot right now.
- yters 9y agoThe only thing EAs have going for them is a biological metaphor, the magic of Darwinian evolution, fountain of endless novelty. But, modern science shows evolution does not really work in a Darwinian manner, so thus the metaphor ends.
- _mhr_ 9y agoCan you provide a source for what modern science you're referring to? What alternative to Darwinian evolution do you have in mind?
- yters 9y agohttps://en.wikipedia.org/wiki/Extended_evolutionary_synthesis https://en.wikipedia.org/wiki/Extended_evolutionary_synthesi... Essentially, variation comes from many other sources than random mutation on DNA. Random mutation itself is seen as mostly a bad source of variation, leading to destruction of the genome.
- _mhr_ 9y agoThat's a very interesting hypothesis, thank you for the link. However, it doesn't seem to support what you're claiming about mutations, from my cursory reading. Can you provide a source for this claim that random mutation is a bad source of variation? http://extendedevolutionarysynthesis.com/about-the-ees/why-is-the-ees-contentious/ http://extendedevolutionarysynthesis.com/about-the-ees/why-i... explicitly rejects the idea of a revolution regarding mutation and other genetic sources of variation: > How can the EES seek 'profound change' and yet disavow 'revolution'? > All recognized causes of both evolution (e.g. natural selection, genetic drift, mutation, etc) and inheritance (e.g. genes), as well as the vast body of empirical and theoretical findings generated by the field of evolutionary biology, are accepted by the EES. > Hence the EES does not entail a rejection of current understanding within the field, and does not require revolution. The EES seeks only to supplement the existing causal framework through recognition of additional causes of evolution (e.g. developmental bias) and inheritance (e.g. epigenetic inheritance), entirely complementary to those long-established within the field. Nevertheless, should these additional processes prove to be important, the conceptual change to evolutionary biology could very well be fundamental. Although not in your source, I did find the following. Known as Drake's rule: as a genome's size increases, the mutation rate also tends to decrease. https://en.wikipedia.org/wiki/Genome_size#Drake's_rule https://en.wikipedia.org/wiki/Genome_size#Drake's_rule. A recent update to Drake's rule suggests that mutation rate is also negatively correlated with population size too, not just genome size (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3494944/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3494944/). And another interesting article about mutation in reproduction: https://www.nature.com/articles/ncomms15183 https://www.nature.com/articles/ncomms15183 (somatic mutation is two orders of magnitude higher than germline mutation). This is intriguing, though I have to wonder how the genome ever grows if mutation supposedly becomes so strict over time as to become a non-factor (transposons, gene duplication?). It's worth noting that mutations do occur more frequently in non-coding sections of the genome, which may not be accounted for in the studies I've linked to. Still, regardless of my sources, I would like to see you provide support from specifically EES proponents for the devaluation of mutation as a source of genetic variation, as you implied.
- andreyk 9y ago"Like Deep Learning (DL), EC was introduced decades ago, and it is currently experiencing a similar boost from the available big compute and big data. However, it addresses a distinctly different need: Whereas DL focuses on modeling what we already know, EC focuses on creating new knowledge." What utter nonsense. Genetic Algorithms do exactly the same thing that Deep Learning methods do: optimize a function for a particular criterion. Genetic Algorithms are useful when taking gradients is not viable, as with RL methods - and RL methods can use Deep Learning! Seriously misleading. Also, this: "Remarkably, although several human-designed LSTM variations have been proposed, they have not improved performance much—LSTM structure was essentially unchanged for 25 years. Our neuroevolution experiments showed that it can, as a matter of fact, be improved significantly by adding more complexity, i.e. memory cells and more nonlinear, parallel pathways." - this is not at all a new idea? How can you even pretend what you're doing is novel.
- deleted 9y ago[deleted]
- antirez 9y agoGenetic algorithms yes but genetic programming is actually able to invent new things. Possibly optimizing the set of weight of a neural network to solve a given problem is more similar to genetic programming, if you see the NN as a computational unit.
- andreyk 9y agoGenetic algorithms 'invent new things' by doing exactly the same thing as other optimization methods - tweaking the values of particular parameters. The only difference in is how they do so.
- api 9y agoIsn't this kind of a banal statement? Doesn't everything that learns in any way whatsoever "tweak values of particular parameters"?
- pishpash 9y agoWould the B-school types leave science and engineering to real scientists and engineers, please?
- deleted 9y ago[deleted]
- jmmcd 9y agoLook up the author's name and then see if you can stand behind your comment.
- jnwatson 9y agoI had success with GP because, as a programmer, I found it straightforward to map the problem domain onto a set of operations. Mapping the problem domain, IMHO, is the hardest part, and in all of my problems, it was hard to map it to differentiable functions. GP doesn't have that problem.
- Mc_Big_G 9y agoI submitted 4 bars of a Boston song and what the AI generated was incredible if you're deaf or enjoy bleeding from the ears.
- patkai 9y agoI wrote my MSc thesis on Genetic Algorithms in 1998 and I've been waiting for the time when they become popular. There is a lot of discussion going on about the need for "explainable models" and I'm quite surprised that it's not considered trivial that e.g. Genetic Programming builds computer programs that are actually models. Explainability is of course harder but how much closer can you get to building models automatically?
- cruzai 9y agoDon't want to jump into the fight between DL and Genetic algorithms, but can somebody explain their experience with the music paper, demo, and work? I personally am not impressed...Are you?
- cruzai 9y agoI believe these type of algorithms work really well for stocks but not music, GANS work better for music. What is your take?
- LMSchmitt 9y agoSchmitt, Lothar M (2001), Theory of Genetic Algorithms, Theoretical Computer Science 259: 1–61 Schmitt, Lothar M (2004), Theory of Genetic Algorithms II: models for genetic operators over the string-tensor representation of populations and convergence to global optima for arbitrary fitness function under scaling, Theoretical Computer Science 310: 181–231
- yters 9y agoIf evolutionary algorithms are so magical, why do I only encounter them in academia?
- Jack000 9y agothey're slow and if you had even an approximate analytical solution, you'd use that instead. evolutionary algorithms are used in practice when there is no real alternative. eg. bin packing for CNC/laser machines (self-plug svgnest.com)
- randomsearch 9y agoThey're fairly widely used, but often in places where they are not well publicised - e.g. engineering optimisation or financial trading.
- yters 9y agoMy MSc advisor wrote a big book on multi-objective evolutionary optimization. http://www.springer.com/gp/book/9780387332543 http://www.springer.com/gp/book/9780387332543 He liked to have his students compare random search to evolutionary algorithms. There tended to not be a huge difference. I think that's why they are not so widely used when there is any kind of better method around. Probably in most cases you'd want to just understand the domain better. Hence, I don't believe EAs are the next big thing.