3 ms·
So basically SGD based NEAT?
by deepnotderp 9y ago
So basically SGD based NEAT?
- YaxelPerez 9y agoNEAT just uses GA to generate a network topology and weights. From what I read, I think this is just a fancy way to parallelize searching for optimal hyperparameters.
- deepnotderp 9y agoWell, okay, what I meant is that it's literally applying evolutionary algorithms for hyperparameter optimization. Calling it some souped up BS like "population based training" seems like Deepmind marketing is getting out of hand...
- kirillseva 9y agoMaybe they have a quota on how many impressions they need to get per quarter?
- nametube 9y agoEvolutionary Algorithms are a subset of Population Based heuristics. I don't think its "souped up BS" to use the term.
- Rhapso 9y agoNEAT paper link I post a lot on HN: http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf Looks like like a "not a GA we promise" on hyper-parameter selection (which is cool if unnecessarily obtuse)