3 ms·
the title mentions two new evolutionary algorithms, and I think it would be good if the title clarifies which two are new. it seems the new ones are the genetic
by spencerchubb 2y ago
the title mentions two new evolutionary algorithms, and I think it would be good if the title clarifies which two are new. it seems the new ones are the genetic algorithm and differential evolution
i find it interesting that Gradient-Free-Optimizers is used in a library for hyperparameter optimization. so in essence using a gradient-free approach to optimize a gradient-based approach
- 528491 2y agoThe title was to long, but I edited my comment for clarification. Hyperparameter optimization is normally done with gradient-free-optimization techniques, since a gradient cannot be computed. This is opposed to the optimization of parameters during training (e.g. neural network weights).
- nickpsecurity 2y agoI was looking for papers on this topic a while back. Here’s one which lists many derivative-free methods: https://arxiv.org/abs/1904.11585 https://arxiv.org/abs/1904.11585
- spencerchubb 2y agothat's quite the comprehensive paper! it's almost like a mini textbook