3 ms·

Check out this benchmark where they did an analysis: https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/community-content/vertex_model_garden/be

Check out this benchmark where they did an analysis: https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/community-content/vertex_model_garden/benchmarking_reports/jax_vit_benchmarking_report.md https://github.com/GoogleCloudPlatform/vertex-ai-samples/blo.... At the bottom, it shows the calculations around the 30% cost efficiency of TPU vs GPU. Our range of 30-70% is based on some numbers we collected from running fine-tuning runs on TPU and comparing them to similar runs on NVIDIA (though not using our code but other OSS libraries).

p1esk 2y ago
It would be a lot more convincing if you actually ran it yourself and did a proper apples to apples comparison, especially considering that’s the whole idea behind your project.
- felarof 2y ago
  Totally agree, thanks for feedback! This is one of the TODOs on our radar.
- KaoruAoiShiho 2y ago
  It's also comparing prices on google cloud, which has its own markup, a lot more expensive than say runpod. Runpod is $1.64/hr for the A100 on secure cloud while the A100 on Google is $4.44/hr. A lot more expensive... yeah. So in that context a 30% price beat is actually a huge loss overall.
  - spullara 2y ago
    who trains on a100 at this point lol
    - KaoruAoiShiho 2y ago
      It's the chosen point of comparison on the linked paper.