3 ms·
Anthropic uses both. From Claude 3's technical report: Like its predecessors, Claude 3 models employ various training methods, such as unsupervised learning a
by ipsum2 2y ago
Anthropic uses both.
From Claude 3's technical report:
Like its predecessors, Claude 3 models employ various training methods, such as unsupervised learning and Constitutional AI [6]. These models were trained using hardware from Amazon Web Services (AWS) and Google Cloud Platform (GCP), with core frameworks including PyTorch [7], JAX [8], and Triton [9].
JAX's GPU support is practically non-existent, it is only used on TPUs.