3 ms·
It's the alleged size of GPT4. There's no official info anymore about architectures from OpenAI since they turned for-profit. But if the number is true, the new
by sigmoid10 3y ago
It's the alleged size of GPT4. There's no official info anymore about architectures from OpenAI since they turned for-profit. But if the number is true, the new generation of cards still won't be able to run GPT4 on a single instance, because even with 4bit, it would need 900GB of VRAM just for the parameters. You'd need at least four B200s for that. And we're not even talking about activations yet.