3 ms·
This page has plots of performance of a certain agent on these different environments: https://openai.com/blog/procgen-benchmark/ https://openai.com/blog/procge
by xamuel 7y ago
This page has plots of performance of a certain agent on these different environments: https://openai.com/blog/procgen-benchmark/ https://openai.com/blog/procgen-benchmark/
Question to anyone familiar with this stuff: I can't figure out which agent they're running on these environments to create the plots in the above link. Is it some well-known agent which is supposed to be clear from context?
- rivesunder 7y agoThey use Proximal Policy Optimization, which is pretty much the go-to algorithm for RL at OpenAI. It was developed by the last author of procgen, John Schulman, et al. (https://openai.com/blog/openai-baselines-ppo/ https://openai.com/blog/openai-baselines-ppo/)
- gwern 7y agoIt is OpenAI so you can safely assume that it's their PPO workhorse agent. But if you were unsure, they provide repos and papers for further details, both of which mention early on the agent ( https://github.com/openai/train-procgen#try-it-out https://github.com/openai/train-procgen#try-it-out and https://cdn.openai.com/procgen.pdf#page=4 https://cdn.openai.com/procgen.pdf#page=4 ).