3 ms·
> Can Language Models Be Too Big? That's interesting, GPT-n with 100T parameters would be bored by just reading the whole internet. Too little information, rep
by visarga 5y ago
> Can Language Models Be Too Big?
That's interesting, GPT-n with 100T parameters would be bored by just reading the whole internet. Too little information, repetitive and on average, junk.
You can try the question in reverse too: Can evolution use too much energy? How much energy has it already consumed?