5 ms·
It’s available on GCP through Cloud TPU, though Nvidia on GCP is still a far bigger business.
by season2episode3 2y ago
It’s available on GCP through Cloud TPU, though Nvidia on GCP is still a far bigger business.
- ArtTimeInvestor 2y agoCan you run LLAMA on Google's TPUs?
- xnx 2y agoYes. You can serve Llama on TPU: https://cloud.google.com/vertex-ai/docs/predictions/serve-llama3-with-saxml-tpu https://cloud.google.com/vertex-ai/docs/predictions/serve-ll... You can also train Llama on TPU: https://cloud.google.com/tpu/docs/v5p-training https://cloud.google.com/tpu/docs/v5p-training