2 ms·
I think this work is great. A lot of top researchers claim that obvious deficiencies in LLM training are fundamental flaws in transformer architecture, as they
by killerstorm 2y ago
I think this work is great.
A lot of top researchers claim that obvious deficiencies in LLM training are fundamental flaws in transformer architecture, as they are interested in doing some new research.
This work show that temporary issues are temporary. E.g. LLM is not trained on grid inputs, but can figure things out after preprocessing.
- whiplash451 2y agoMy claim is _not_ that this work is not useful. But however "great" your work is, misleading on the steps you took during your experiments and overselling your results is never a valid approach in research.
- killerstorm 2y agoThis is a blog post, sir. All details are written down. He's very clear about methods, it seems you're 1) biased; 2) have too high standards for blog posts.