4 ms·
Lol, they state that their model is a 1000 times more powerful than BERT? Under what metric?
by rubatuga 5y ago
Lol, they state that their model is a 1000 times more powerful than BERT? Under what metric?
- aledalgrande 5y agoThat's what I was wondering! Such gibberish
- YetAnotherNick 5y agoAccording to my understanding they are referring to parameter count. If we go by that logic, BERT has 340M parameters. GPT3 has 175B. So this will have 340B parameters?
- deleted 5y ago[deleted]
- contravariant 5y agoWell so far the're mostly talking about what it would be able to do, so it's probably more wishful thinking than any exact metric.