Many Thanks for the untrained version - I am working on visualising the evolving genome based on your RGBA illustration. I read Sutton and Barto on Q-Learning

Many Thanks for the untrained version - I am working on visualising the evolving genome based on your RGBA illustration. I read Sutton and Barto on Q-Learning but only 'got' it when I saw it hand-done with matrix math. http://mnemstudio.org/path-finding-q-learning-tutorial.htm http://mnemstudio.org/path-finding-q-learning-tutorial.htm Sutton & Barto suggest Eligibility Traces seem necessary to make Q learn fast enough. http://webdocs.cs.ualberta.ca/~sutton/book/ebook/node79.html http://webdocs.cs.ualberta.ca/~sutton/book/ebook/node79.html Gomez's thesis suggests that genetic methods have an advantage over backprop for learning sequences of actions. http://www.cs.utexas.edu/users/nn/downloads/papers/gomez.phdtr03.pdf http://www.cs.utexas.edu/users/nn/downloads/papers/gomez.phd... Deep Q Learning is brilliant - evolving the Q function would certainly be very interesting - currently trying to get the ALE sending frames to my convnet :) mods have helped fix the errant brain code - thanks for the heads up.