Black box optimization such as CMA-ES or Augmented Random Search (ars) are used by researchers, for example: CMA-ES: https://blog.otoro.net/2017/10/29/visual-e

Black box optimization such as CMA-ES or Augmented Random Search (ars) are used by researchers, for example: CMA-ES: https://blog.otoro.net/2017/10/29/visual-evolution-strategies https://blog.otoro.net/2017/10/29/visual-evolution-strategie... ARS: https://arxiv.org/abs/1803.07055 https://arxiv.org/abs/1803.07055 Those optimizers are efficient up to certain neural network sizes.