These "evolved neurons" look ridiculously more complicated and expensive to evaluate than a base neuron for a minor improvement in performance. The Music Maker

These "evolved neurons" look ridiculously more complicated and expensive to evaluate than a base neuron for a minor improvement in performance. The Music Maker paper mentioned that LSTMs haven't changed in "25 years", but didn't mention the 2014 Gated Recurrent Units that have become so popular specifically because they are much more simple to understand and evaluate. This approach seems to be going in the opposite direction. I guess the idea of them being evolved is that you don't _need_ to understand them, but evaluation performance is definitely a concern and doesn't seem to be addressed much. Interesting early work though!