4 ms·
There are some things about this article that irk me, like this: Neural networks have garnered all the headlines, but a much more powerful approach is waiting
by mindcrime 8y ago
There are some things about this article that irk me, like this:
Neural networks have garnered all the headlines, but a much more powerful approach is waiting in the wings.
Granted it's probably written for lay-people who don't know much about AI/ML techniques, but this is still pretty sloppy. It hasn't been proven that EA's are "more powerful" than NN's. And so far as that goes, I'm not even sure it makes sense to use a term like "more powerful" at all in this context. And EA approaches aren't some new, up-and-comer that haven't had their chance yet... those techniques have been around for a long time as well.
All of that said, I'm a big fan of EA's, dating back to when I implemented a parallel GA optimization algorithm in a parallel programming class in college. I've been fascinated with them ever since, and I do think that evolutionary approaches have a lot of potential. So I'm happy to see some positive press being directed in that direction, but I still get annoyed with some of the hand-wavy stuff and sloppy language.
Anyway, one thing about (some|many|most?) EA approaches is that they parallelize very well. And depending on what you're doing, you aren't necessarily doing Linear Algebra / matrix math, so you can likely accomplish a lot without spending beaucoup $$ on GPU's. A Beowulf cluster of CPU machines can be pretty effective.
- eggy 8y agoI read Koza's "Genetic Programming: On the Programming of Computers by Means of Natural Selection" back in 1993, and a lot of the holdups were that computers and memory just weren't as good as today to deal with large solution space trials. Also, dead ends due to the choice of starting functions to evolve. Today using TWEANNs and other methods (Topology and Weight Evolving Neural Networks) is really a good way to go. I still like the early examples in Koza GP where you give it a few functions to evolve a boolean function. I had started studying neural networks way back in the 80s and hit pay dirt with Mark Watson's 1991 "Common LISP Modules. Artificial Intelligence in the Era of Neural Networks and Chaos Theory", which threw me into NLP, Chaos, and ANNs.