2 ms·
> the pro and flash variants are 5x to 10x smaller than opus and gpt-5 class models. The rumor is that Gemini Pro is the largest model being served today (or
by nl 6mo ago
> the pro and flash variants are 5x to 10x smaller than opus and gpt-5 class models.
The rumor is that Gemini Pro is the largest model being served today (or at least was prior to Mythos)
Source: some podcast where they were discussing TPU vs Nvidia cluster topologies, and how Google is exploiting their topology to allow this. But I can't remember exactly which podcast, so hopefully someone else will know.