3 ms·

For the Alpha Zero fans among us, how many of these does it take to match the performance of four 2nd gen Google TPUs?

by tromp 9y ago

bitL 9y ago
I think one Titan V should be around the same performance as 4xTPUv2, which is their basic module.
- jacksmith21006 9y ago
  Based on what Google has shared a second generation TPU which includes four chips is capable of 180 Tflops which would be a decent amount more powerful than this new Nvidia option.
Quequau 9y ago
Is it possible for a regular human to even buy four 2nd gen Google TPUs?
- samfriedman 9y ago
  Google is beginning to offer them on their Cloud services: https://www.blog.google/topics/google-cloud/google-cloud-offer-tpus-machine-learning/ https://www.blog.google/topics/google-cloud/google-cloud-off...
- farresito 9y ago
  Speaking about buying TPUs, yesterday I vaguely remembered that the company that sells mining ASICs like the Antminer was planning to start selling AI chips ala Google's TPU. I checked their website and they have actually started selling them already https://www.sophon.ai/ https://www.sophon.ai/ I think it's pretty exciting seeing how we are getting increasingly more specific chips for AI tasks. I wonder what their performance is like compared to GPUs.
  - DiThi 9y ago
    > SEC_ERROR_UNKNOWN_ISSUER Is this because in China you're expected to ignore all certificate warnings? > I wonder what their performance is like compared to GPUs. Me too. I tried to find a similar table and found this: https://github.com/tobigithub/tensorflow-deep-learning/wiki/tf-benchmarks#alexnet https://github.com/tobigithub/tensorflow-deep-learning/wiki/... 25 ms/batch of 128 is 5120 images/second... Is that correct? Am I missing something?
    - farresito 9y ago
      > SEC_ERROR_UNKNOWN_ISSUER I can access it no problem with Chrome. The price seems to be 589$ per chip. Google wrote an article some time ago about the their TPUs. There are a few charts at the end of the page: https://cloud.google.com/blog/big-data/2017/05/an-in-depth-look-at-googles-first-tensor-processing-unit-tpu https://cloud.google.com/blog/big-data/2017/05/an-in-depth-l... I would be quite interested in a comparison between Google's TPUs and this Sophon chip, but it seems it's quite new and they have barely started selling them, so we might have to wait. > 25 ms/batch of 128 is 5120 images/second... Is that correct? Am I missing something? I'm not particularly knowledgeable about this, so you will have to wait for someone experienced to chime in.

For the Alpha Zero fans among us, how many of these does it take to match the performance of four 2nd gen Google TPUs?

by tromp 9y ago

For the Alpha Zero fans among us, how many of these does it take to match the performance of four 2nd gen Google TPUs?

bitL 9y ago

I think one Titan V should be around the same performance as 4xTPUv2, which is their basic module.

jacksmith21006 9y ago
Based on what Google has shared a second generation TPU which includes four chips is capable of 180 Tflops which would be a decent amount more powerful than this new Nvidia option.

Quequau 9y ago

Is it possible for a regular human to even buy four 2nd gen Google TPUs?

samfriedman 9y ago
Google is beginning to offer them on their Cloud services: https://www.blog.google/topics/google-cloud/google-cloud-offer-tpus-machine-learning/ https://www.blog.google/topics/google-cloud/google-cloud-off...
farresito 9y ago
Speaking about buying TPUs, yesterday I vaguely remembered that the company that sells mining ASICs like the Antminer was planning to start selling AI chips ala Google's TPU. I checked their website and they have actually started selling them already https://www.sophon.ai/ https://www.sophon.ai/ I think it's pretty exciting seeing how we are getting increasingly more specific chips for AI tasks. I wonder what their performance is like compared to GPUs.
- DiThi 9y ago
  > SEC_ERROR_UNKNOWN_ISSUER Is this because in China you're expected to ignore all certificate warnings? > I wonder what their performance is like compared to GPUs. Me too. I tried to find a similar table and found this: https://github.com/tobigithub/tensorflow-deep-learning/wiki/tf-benchmarks#alexnet https://github.com/tobigithub/tensorflow-deep-learning/wiki/... 25 ms/batch of 128 is 5120 images/second... Is that correct? Am I missing something?
  - farresito 9y ago
    > SEC_ERROR_UNKNOWN_ISSUER I can access it no problem with Chrome. The price seems to be 589$ per chip. Google wrote an article some time ago about the their TPUs. There are a few charts at the end of the page: https://cloud.google.com/blog/big-data/2017/05/an-in-depth-look-at-googles-first-tensor-processing-unit-tpu https://cloud.google.com/blog/big-data/2017/05/an-in-depth-l... I would be quite interested in a comparison between Google's TPUs and this Sophon chip, but it seems it's quite new and they have barely started selling them, so we might have to wait. > 25 ms/batch of 128 is 5120 images/second... Is that correct? Am I missing something? I'm not particularly knowledgeable about this, so you will have to wait for someone experienced to chime in.