3 ms·
Implementation and Sustainability Hardware: Gemini 3 Pro was trained using Google’s Tensor Processing Units (TPUs). TPUs are specically designed to handle the m
by davidguetta 8mo ago
Implementation and Sustainability
Hardware: Gemini 3 Pro was trained using Google’s Tensor Processing Units (TPUs). TPUs are
specically designed to handle the massive computations involved in training LLMs and can speed up
training considerably compared to CPUs. TPUs often come with large amounts of high-bandwidth
memory, allowing for the handling of large models and batch sizes during training, which can lead to
better model quality. TPU Pods (large clusters of TPUs) also provide a scalable solution for handling the
growing complexity of large foundation models. Training can be distributed across multiple TPU devices
for faster and more efficient processing.
So google doesn't use NVIDIA GPUs at all ?
- PunchTornado 8mo agono. only tpus
- paride5745 8mo agoAnother reason to use Gemini then. Less impact on gamers…
- TiredOfLife 8mo agoTPUs still use ram and chip production capacity
- dekhn 8mo agoWhen I worked there, there was a mix of training on nvidia GPUs (especially for sparse problems when TPUs weren't as capable), CPUs, and TPUs. I've been gone for a few years but I've heard a few anecdotal statements that some of their researchers have to use nvidia GPUs because the TPUs are busy.
- lejalv 8mo agoBla bla bla yada sustainability yada often come with large better growing faster... It's such an uninformative piece of marketing crap
- rjh29 8mo agoI assume that's a Gemini LLM response? You can tell Gemini is bullshitting when it starts using "often" or "usually" - like in this case "TPUs often come with large amounts of memory". Either they did or they didn't. "This (particular) mall often has a Starbucks" was one I encountered recently.
- w10-1 8mo agoIt's not bullshit (i.e., intended) but probabilities all the way down, as Hume reminded us: from observations, you can only say the sun will likely rise in the east. You'd need to stand behind a theory of the world to say otherwise (but we were told "attention is all you need"...)
- sdeiley 8mo agoGoogler. We use GPUs, but its a drop in the bucket in the sea of our accelerators. We might sell more GPUs in Cloud than we use internally. These are not data driven observations just vibes