2 ms·
Yes. You can serve Llama on TPU: https://cloud.google.com/vertex-ai/docs/predictions/serve-llama3-with-saxml-tpu https://cloud.google.com/vertex-ai/docs/predict
by xnx 2y ago
Yes. You can serve Llama on TPU: https://cloud.google.com/vertex-ai/docs/predictions/serve-llama3-with-saxml-tpu https://cloud.google.com/vertex-ai/docs/predictions/serve-ll...
You can also train Llama on TPU: https://cloud.google.com/tpu/docs/v5p-training https://cloud.google.com/tpu/docs/v5p-training