4 ms·

Google is running its own TPU hardware for internal workloads. I believe Nvidia is just resold for cloud customers.

• ipsum2 2y ago
  Nvidia GPUs are also used for inference on Google products. It just depends on availability.
  • danpalmer 2y ago
    Interesting, do you have a source for this? I've not been able to find one.
    • nextos 2y ago
      GCP plans offer access to high-end NVIDIA GPUs, as well as TPUs. I thought Google products use the same pool of resources that is also resold to customers?
      • eitally 2y ago
        Only some Google products. Most still run on internal platforms, not GCP.
        • nextos 2y ago
          OK, interesting, so there is some dogfooding, but it's not complete.
      • deleted 2y ago
        [deleted]
• okdood64 2y ago
  Huh? https://cloud.google.com/tpu/docs/intro-to-tpu https://cloud.google.com/tpu/docs/intro-to-tpu
• deeth_starr_v 2y ago
  Not true. Apple trained some models on their TPU
  • danpalmer 2y ago
    Apologies, to be clear what I meant was that to my knowledge Google doesn't use GPUs for it's own stuff, but does sell both TPUs and GPUs to others on Cloud. Also, to be clear, I have no internal info about this, I'm going based on external stuff I've seen.