8 ms·
Well, there's also the huge LLM which is probably ~70-100 billions of parameters (just estimates for 3.5 Sonnet), running on a farm of GPUs that cost tens of th
by Tiberium 2y ago
Well, there's also the huge LLM which is probably ~70-100 billions of parameters (just estimates for 3.5 Sonnet), running on a farm of GPUs that cost tens of thousands of dollars. But in summary you're correct :)