4 ms·

What you are saying contradicts to my reading of publication.

• famouswaffles 2y ago
  Their method does not require building specialized models from scratch (you can but you don't have to) and they did not prove transformers can't learn sorting. If you think they did, then you don't understand what it means to prove something.
  • riku_iki 2y ago
    In my books what they built (specialized training data + specialized embeddings format) is exactly specialized model. You can disagree of course and say again that I don't understand something, but discussion will be over.
    • famouswaffles 2y ago
      The data isn't specialized ? A poor result when testing one model is not proof that the architecture behind the model is incapable of getting good results. It's just that simple. The same way seeing the OG GPT-3 fail at chess was not proof LLMs can't play chess. This >They also demonstrated that transformer can't learn sorting. is just wrong. Nothing more to it.