4 ms·

Would be interesting to see this for various test functions with various starting parameters. Here is a large compilation of various test functions: http://infi

Would be interesting to see this for various test functions with various starting parameters. Here is a large compilation of various test functions: http://infinity77.net/global_optimization/genindex.html http://infinity77.net/global_optimization/genindex.html

p1esk 10y ago
The functions in your link are not gradient based, not sure how they are applicable to neural networks with backprop.
- hacker42 10y ago
  Don't know what fraction of them, but most of them look differentiable (as long it is not exactly some variant of the Weierstrass function).
  - p1esk 10y ago
    True, but I think these functions are intended for non-gradient based optimization algorithms.