4 ms·
I think Anthropic also uses Google TPUs.
by mupuff1234 2y ago
I think Anthropic also uses Google TPUs.
- seanhunter 2y agoI don't think that is the case. AWS is a very significant investor and if you meet with their business development team they will recommend deploying on bedrock (which is Nvidia). There are also press releases like this[1] stating they use Nvidia. [1] https://nvidianews.nvidia.com/news/aws-and-nvidia-collaborate-on-next-generation-infrastructure-for-training-large-machine-learning-models-and-building-generative-ai-applications https://nvidianews.nvidia.com/news/aws-and-nvidia-collaborat... and https://press.aboutamazon.com/2023/3/aws-and-nvidia-collaborate-on-next-generation-infrastructure-for-training-large-machine-learning-models-and-building-generative-ai-applications https://press.aboutamazon.com/2023/3/aws-and-nvidia-collabor... search for "anthropic"
- mupuff1234 2y agoGoogle also has a significant stake and I believe is an early investor. https://www.datacenterdynamics.com/en/news/anthropic-to-use-google-tpu-v5e-chips-to-train-generative-ai-models/ https://www.datacenterdynamics.com/en/news/anthropic-to-use-... https://www.anthropic.com/news/anthropic-partners-with-google-cloud https://www.anthropic.com/news/anthropic-partners-with-googl...
- ipsum2 2y agoAnthropic uses both. From Claude 3's technical report: Like its predecessors, Claude 3 models employ various training methods, such as unsupervised learning and Constitutional AI [6]. These models were trained using hardware from Amazon Web Services (AWS) and Google Cloud Platform (GCP), with core frameworks including PyTorch [7], JAX [8], and Triton [9]. JAX's GPU support is practically non-existent, it is only used on TPUs.