3 ms·
Pretraining a frontier model is a one-time expense: 6,000 to 25,000 GPUs for one to four months, $5M to $150M depending on chip generation and luck.
by dweinus 2mo ago
Pretraining a frontier model is a one-time expense: 6,000 to 25,000 GPUs for one to four months, $5M to $150M depending on chip generation and luck.