4 ms·
We do, via TRC. Eleuther does too. I think it’s a bad idea to have a fatalistic attitude towards model reproduction.
by sillysaurusx 3y ago
We do, via TRC. Eleuther does too. I think it’s a bad idea to have a fatalistic attitude towards model reproduction.
- hedgehog 3y agoExactly, nice work BTW. And no hate for Mistral, they're doing great work, but let's not confuse weights-available with fully open models.
- emadm 3y agoWith all the new national supercomputers scale isn’t really going to be an issue, they all want large language models on 10k GH200s or whatever and the libraries are getting easier to use