3 ms·
What about training costs? > Training GPT-4 may have cost in the vicinity of $50 million but the overall training cost is probably more than $100 million becau
by pier25 1y ago
What about training costs?
> Training GPT-4 may have cost in the vicinity of $50 million but the overall training cost is probably more than $100 million because compute is required for trial and error before the final training run.
https://ainowinstitute.org/publications/compute-and-ai https://ainowinstitute.org/publications/compute-and-ai