> we were able to solve one of the hardest MuJoCo tasks (a 3D humanoid) using 1,440 CPUs across 80 machines in only 10 minutes. As a comparison, in a typical se

> we were able to solve one of the hardest MuJoCo tasks (a 3D humanoid) using 1,440 CPUs across 80 machines in only 10 minutes. As a comparison, in a typical setting 32 A3C workers on one machine would solve this task in about 10 hours. So using 80 times more machines makes you 60 times faster (assuming those are the same machines) "while performing better on 23 games tested, and worse on 28"[0]? [0] The paper for this blog post https://arxiv.org/pdf/1703.03864.pdf https://arxiv.org/pdf/1703.03864.pdf Asynchronous advantage actor critic (A3C) https://arxiv.org/pdf/1602.01783.pdf https://arxiv.org/pdf/1602.01783.pdf