4 ms·
It's not new. A paper in 2021 [0] showed you can train a quadruped robot to walk in minutes using parallel simulation in GPU, and then deploy it on the physica
by hcrisp 4y ago
It's not new. A paper in 2021 [0] showed you can train a quadruped robot to walk in minutes using parallel simulation in GPU, and then deploy it on the physical robot. Being parallel it is faster, and more so if on GPU. But sim-to-reality transfer is still a concern, and the architecture doesn't help if there are sparse rewards.
[0] https://arxiv.org/abs/2109.11978?context=cs.LG https://arxiv.org/abs/2109.11978?context=cs.LG
- yanglet 4y agoThanks for the information and sharing the paper. I also read it. Agree with you that the "simulation-to-reality gap" would be more critical to the reinforcement learning community.