4 ms·
Speculative comments: evolving neural network architectures may be where EAs prove their worth. Plenty of work on it but it’s early days and we need massive, m
by randomsearch 5y ago
Speculative comments: evolving neural network architectures may be where EAs prove their worth.
Plenty of work on it but it’s early days and we need massive, massive, compute power.
- apl 5y agoNeural architecture search (NAS) is a thing! But it's almost exclusively based on meta-gradients. Again, wouldn't put my money on GAs ever outperforming gradient-based methods again.
- tomrod 5y agoIs the parameter space convex?
- api 5y agoGAs follow gradients too. It's a different learning approach. All learning follows gradients in one form or another except brute force search, which is not feasible for anything larger than about 2^80 bits of state space. Evolution is not brute force.
- sitkack 5y agoCan you combine NAS and GAs?