4 ms·
Can't we use kiclstarter or other fund raising sites to train a gpt-4 like powerful model?
by freakynit 4y ago
Can't we use kiclstarter or other fund raising sites to train a gpt-4 like powerful model?
- Tepix 4y agoThis shouldn't be a one-time affair
- oceanplexian 4y agoI would avoid kickstarter for any AI related work, they made it clear after banning a few projects that they want to push their flavor of AI ethics on creators (e.g. https://updates.kickstarter.com/ai-current-thinking/ https://updates.kickstarter.com/ai-current-thinking/). IMO we need an alternative infrastructure for organizing and funding these things, since it's clear Big Tech sees AI as a threat and wants to desperately shut it down.
- pixl97 4y agoCorporations are raising billions (with a B) of dollars to create and develop AI models. With that money they are buying up every bit of compute they possibly can. I'm not sure what level of funding you're going to get in your actions, but it's not going to be anywhere close to the levels needed.
- olalonde 4y agoWhich corporations? There were some estimates that GPT-3 cost under 5M$ to train[0]. [0] https://lambdalabs.com/blog/demystifying-gpt-3 https://lambdalabs.com/blog/demystifying-gpt-3
- MacsHeadroom 4y agoAnthropic plans to spend $1B on compute to train Claud-Next-10X (10x the size of GPT-4 according to their own leaked documents) over the next 18 months. They also plan to raise $5B over the next 5 years. OpenAI has secured over $10B in funding. GPT-3 is not GPT-3.5 or GPT-4. Each costs exponentially more than the last in compute and dollars.