4 ms·

I wasn't able to play the video for some reason, but I located it on YouTube: https://m.youtube.com/watch?v=ZisFfiEdQ_E https://m.youtube.com/watch?v=ZisFfiEdQ

• Zitrax 11y ago
  Isn't the score based only on the first level ?
• nrmn 11y ago
  Not OP but I believe the low score is due to not enough training time and incorrect parameters such as frameskip. Space Invaders was mentioned as one of the few games they needed to lower the frameskip (from 4 to 3 or 2?) on because of the flashing lasers. I'm assuming OP left the parameters as is from the implementation by Nathan Sprague, which has frameskip at 4, and trained for a few epochs.
  • alexlikeits1999 11y ago
    Changing the frameskip is not needed any more since the implementation does max of last two frames before processing (same as what DeepMind does) EDIT: talking about Sprague's implementation btw, not necessarily OPs.
    • mjaskowski 11y ago
      Actually I did both frame skipping and amxing out two frames as reported in the Natures letter https://storage.googleapis.com/deepmind-data/assets/papers/DeepMindNature14236Paper.pdf https://storage.googleapis.com/deepmind-data/assets/papers/D...
• mjaskowski 11y ago
  I noticed that the video does not work in Safari. Interesting. I am not sure how this deepmind game was played. Note that a typical game with epsilon = 0.1 achieves results around 550 points. In the nature paper they were running the game with epsilon = .05 If you spot any other differences I'd be happy to learn about them.