2 ms·
From a quick scan of the paper, it seems the issue is not that the RL technique doesn't work (the chips do function) but that the claim that RL is just a really
by mike_hearn 4y ago
From a quick scan of the paper, it seems the issue is not that the RL technique doesn't work (the chips do function) but that the claim that RL is just a really bad and inefficient way to do it. Key paragraph:
"We find that RePlAce [non AI] produces 26% better wirelength than RL [reinforcement learning] whilst using 5 orders of magnitude less computation"
If that's true then you can see why he criticized the Nature paper. It's not a small difference in performance. The classical techniques are just crushing the AI in this paper.