3 ms·
(2022) It feels like a joke, but the fact they are mentioning GPT-3 and Megatron-Turing as the hottest new things makes this piece seem so outdated.
by cubefox 3y ago
(2022)
It feels like a joke, but the fact they are mentioning GPT-3 and Megatron-Turing as the hottest new things makes this piece seem so outdated.
- hyperbovine 3y agoThe relevant lifespan of a paper in this field appears to average about three months. Can't really hold that against them.
- jprd 3y agoIf you say "Transformer" and "Megatron" in the same sentence, you have my full-attention for at least enough time to start making a serious observation about ML, or frankly, anything.
- moffkalast 3y agoOnce they realize they can distil and quantize Megatron, I suppose they'll name that one "Starscream"?
- DaiPlusPlus 3y ago> If you say "Transformer" and "Megatron" in the same sentence, you have my full-attention And as they say, attention is all you need
- amelius 3y agoAny self-respecting AI researcher writes self-updating papers.