4 ms·

Is this different than VecEnv in baselines? https://github.com/openai/baselines/blob/master/baselines/common/vec_env/subproc_vec_env.py https://github.com/open

• MutatedFlood 7y ago
  Thanks for the feedback. OpenAI said they used multiple processes (it seems that they used multiprocessing module from your link). Processes is handled by OS and, it depends, sometimes will only switch to another process on long CPU stalls. I used an event loop to manage that, which supposedly should be fixed those long stalls. Also, this version runs on a single CPU while OpenAI's probably won't, given a multicore CPU. My initial thought was that extending using multiprocessing is much easier than wrapping it using an event loop, hence I only implemented the event loop part.
  • mooneater 7y ago
    Thanks!