I wonder if these guys are a bit quick to give themselves credit. There's a lengthy (and depressing) series of posts by Ben Recht[1] that basically outlines al

I wonder if these guys are a bit quick to give themselves credit. There's a lengthy (and depressing) series of posts by Ben Recht[1] that basically outlines all the reasons that model-free RL is effectively bunk if you have access to any model of how the environment evolves. These guys (as far as I can tell), haven't made any attempt to disambiguate how much of the improvement they see is down to having a model of the environment _at all_, as against the specific model they propose. I think there's probably more these guys could do to prove that they're actually onto something and aren't just confusing throwing compute at the problem with a genuinely better solution. [1]: http://www.argmin.net/outsider-rl.html http://www.argmin.net/outsider-rl.html