4 ms·

Title is misleading. “Everywhere we tried” does not include actually beating the performance (or getting particularly close to) sota transformers of the same

Title is misleading. “Everywhere we tried” does not include actually beating the performance (or getting particularly close to) sota transformers of the same size. That said, these models were trained for less time than the sota models so there is promise.

thethirdone 3y ago
What models in particular do you think it should have been compared to? It seems like they chose some of the most understood / cited models at around 1 B parameters.
behnamoh 3y ago
This is the reddit title almost verbatim. If you have a problem with that, you better leave a comment in that thread.
- cwillu 3y ago
  “please use the original title, unless it is misleading or linkbait” --https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
  - behnamoh 3y ago
    Yes, that's right. And I used the original title (though it was way longer).
karmakaze 3y ago
That part was accurately in scare quotes.