3 ms·
> In the same amount of time, you could have 1 epoch or 100 epochs depending on how many GPUs you have. This is just not true for RL and related algorithms, ha
by sudosysgen 2y ago
> In the same amount of time, you could have 1 epoch or 100 epochs depending on how many GPUs you have.
This is just not true for RL and related algorithms, having more GPU/agents encounters diminishing returns, and is just not the equivalent to letting a single agent go through more steps.