4 ms·
This question isn't silly! People have actually trained neural networks to generate other neural networks. The "designer" network is trained using reinforcement
by RoboTeddy 8y ago
This question isn't silly! People have actually trained neural networks to generate other neural networks. The "designer" network is trained using reinforcement learning, with a reward signal that depends on the efficacy of the networks it creates.
See: Neural Architecture Search with Reinforcement Learning (https://arxiv.org/abs/1611.01578 https://arxiv.org/abs/1611.01578)
It looks like they trained the "designer" network by trainning 15,000 deep learning models (800 at a time in parallel over 800 GPUs)