42 ms·
Ah, as to the reinforcement-learning agent- this is also very confusing (because of the use of "engine" to mean both their engine and the Infinite Mario engine
by YeGoblynQueenne 9y ago
Ah, as to the reinforcement-learning agent- this is also very confusing (because of the use of "engine" to mean both their engine and the Infinite Mario engine used in the last experiment) but I think this RL agent was created to play the Infinite Mario engine, not their engine:
For a baseline we drew on the “Infinite Mario” engine used
for the Mario level playing AI competition [Togelius et al.,
2010] and constructed a simple reinforcement learning agent
for the engine utilizing the value iteration algorithm. We further
constructed two variations on this agent. The first made
use of the native forward simulation available in the “Infinite
Mario” engine to construct an initial policy rather than relying
on the typical approach of a uniformly random initial policy.
(...)
In comparison, we constructed an agent that instead made use of
forward simulation according to the learned game engine (with
numerical values and names converted to the appropriate equivalent
in the “Infinite Mario” engine).
I think this means that they used a) a ready-made "forward simulation" agent included in the Infinite Mario engine, b) a RL agent they trained and c) a "forward simulation" agent _using their trained engine values as input_. But all three agents were playing the game on the Infinite Mario engine- not on their learned engine. Their learned engine only served to generate inputs for the "forward simulation".
Which must mean that their engine cannot be played, in the traditional sense, for example by connecting its inputs to the outputs of an AI player, or by giving a controller to a human. If it could, they would most probably be demonstrating this ability by having an AI agent play a game of Mario on their learned engine. This doesn't seem to be possible.
Again- that's my reading and I too am not 100% sure about it, because it's really not made clear in the paper.