4 ms·
I'm curious to whether the recursively trained models degenerate to troglodytes after a couple of generations.
by nnevatie 3mo ago
I'm curious to whether the recursively trained models degenerate to troglodytes after a couple of generations.
- Danau5tin 3mo agoI am also curious! The inner-RL-loop models are only trained once, then disgarded. But the outer-RL-loop model is trained on the same tasks over and over again. I imagine it would overfit after many more steps, but perhaps with a larger set of diverse tasks, the model would simply improve.