For very limited applications you can probably plug and play something like DDQN or A3C, but since we don't have a good algorithm that applies to many RL proble

For very limited applications you can probably plug and play something like DDQN or A3C, but since we don't have a good algorithm that applies to many RL problems, any innovation will take quite a bit of theoretical background. A while ago we tried to use DDQN to self-play a multi-agent pacman environment that we built, it was able to converge but the convergence was very suboptimal. We had to modify the sampling process in order to get slightly better convergence.