3 ms·
Corporations are raising billions (with a B) of dollars to create and develop AI models. With that money they are buying up every bit of compute they possibly c
by pixl97 4y ago
Corporations are raising billions (with a B) of dollars to create and develop AI models. With that money they are buying up every bit of compute they possibly can. I'm not sure what level of funding you're going to get in your actions, but it's not going to be anywhere close to the levels needed.
- olalonde 4y agoWhich corporations? There were some estimates that GPT-3 cost under 5M$ to train[0]. [0] https://lambdalabs.com/blog/demystifying-gpt-3 https://lambdalabs.com/blog/demystifying-gpt-3
- MacsHeadroom 4y agoAnthropic plans to spend $1B on compute to train Claud-Next-10X (10x the size of GPT-4 according to their own leaked documents) over the next 18 months. They also plan to raise $5B over the next 5 years. OpenAI has secured over $10B in funding. GPT-3 is not GPT-3.5 or GPT-4. Each costs exponentially more than the last in compute and dollars.