The article's claim that we can see the "video here" is false - the link is broken. The video is here: https://www.youtube.com/watch?v=DcYLT37ImBY https://www.y

The article's claim that we can see the "video here" is false - the link is broken. The video is here: https://www.youtube.com/watch?v=DcYLT37ImBY https://www.youtube.com/watch?v=DcYLT37ImBY. It is a really interesting showcase and something is happening there that the writer at pvdz.ee didn't seem to find as interesting as I do. There is a concept that I bumped into of "Novelty Search" in the genetic algorithm space. Rather than trying to guess what behaviour is "good" and reward it, instead reward some novelty heuristic. Agents explore the space more thoroughly. The video is a really quite a good showcase of the technique - he only encodes hints on how to play after a pure novelty based approach is shown to fail. pvdz.ee seems to be trying to encode his game knowledge into the reward function early and seemed unsatisfied in the results based on his discussion. If I had a Nvidia graphics card instead of an AMD one, an experiment I'd have run a few years ago was a Go AI that tried to find a novel move heuristic to see if that sped up training. But that was a few years ago, I was defeated by the poor compute driver situation and haven't felt the urge since.