The site is ~3000 words (half of Attention Is All You Need, as a measuring stick) of Eye-Catching Summary Statement\nShort Explanatory Paragraph statements like

The site is ~3000 words (half of Attention Is All You Need, as a measuring stick) of Eye-Catching Summary Statement\nShort Explanatory Paragraph statements like the ones GPT-4 is so fond of generating, and has no formal design model to reason about, no justification on why the design is right, no information on training, no evaluation results, and no code. I can’t help but feel it’s a shame to have published this draft (I hesitate to call it a preprint) before any of the factual content of the article was suitable for publication, since if these improvements are as effective and profound as the summary suggests, you’re doing yourself and your work a disservice by advertising it in a shallow way.