4 ms·
Which corporations? There were some estimates that GPT-3 cost under 5M$ to train[0]. [0] https://lambdalabs.com/blog/demystifying-gpt-3 https://lambdalabs.com/
by olalonde 4y ago
Which corporations? There were some estimates that GPT-3 cost under 5M$ to train[0].
[0] https://lambdalabs.com/blog/demystifying-gpt-3 https://lambdalabs.com/blog/demystifying-gpt-3
- MacsHeadroom 4y agoAnthropic plans to spend $1B on compute to train Claud-Next-10X (10x the size of GPT-4 according to their own leaked documents) over the next 18 months. They also plan to raise $5B over the next 5 years. OpenAI has secured over $10B in funding. GPT-3 is not GPT-3.5 or GPT-4. Each costs exponentially more than the last in compute and dollars.