3 ms·
TSPs are not unsolvable. My point was that Transformers and neural networks as they are now are not Turing machines if you don't allow for the model to grow wi
by shawntan 3y ago
TSPs are not unsolvable.
My point was that Transformers and neural networks as they are now are not Turing machines if you don't allow for the model to grow with the input size. That said, it has to grow in "depth" not just parameters. The fact that people think fixed depth computation can universally compute everything is a worrying trend.