3 ms·
> I don't see why given enough time GAs (or EAs) could not outperform simple backpropagation based on differentiating simple cost functions. It's already happe
by crimsonalucard 9y ago
> I don't see why given enough time GAs (or EAs) could not outperform simple backpropagation based on differentiating simple cost functions.
It's already happened. You are it.
- tree_of_item 9y agoThis was the line of reasoning that led to the initial hype about GAs, but I don't think it's sound. We still don't understand exactly how natural selection works, so there's no reason to believe the GAs we can implement now have the "special sauce" that makes real world natural selection effective. We don't know how to implement genotypes well, we don't know how to implement recombination or mutation well, etc.
- crimsonalucard 9y agoI disagree. The biological brain is a known upper bound for GAs thus we are fully aware of a gap in understanding. This makes it a perfect target for research. Looking at current methods of optimizing neural networks we cannot know if we are far from the upper bound or if we've already reached it... R&D effort in this area could be a dead end.