3 ms·
What would this algorithm be in modern day machine learning terms? Is it similar to anything we have now?
by eternityforest 5y ago
What would this algorithm be in modern day machine learning terms? Is it similar to anything we have now?
- gwern 5y agoI think it would be most similar to tabular Q-learning. It has some weaknesses due to its simplicity, like not decaying the learning rate (you always add/remove from a fixed number of matches; maybe if you used an unbounded number of matches it'd be equivalent?) or having any exploration built-in, so it doesn't enjoy the guarantees tabular Q-learning does like converging to the optimal game play - MENACE would presumably jitter around the optimal strategy if it approached it at all.