3 ms·
>The small team at Mistral is putting their competitors to shame. Them plus 500 million in funding
by htrp 3y ago
>The small team at Mistral is putting their competitors to shame.
Them plus 500 million in funding
- api 3y agoMuch of the cost is probably compute.
- refulgentis 3y agoVery unlikely: note best GPT-4 estimates put at it $45 million
- a_wild_dandan 3y agoAltman said that GPT-4 training was over $100 million. And you need significant additional resources beside just the training run cost.
- tomp 3y agoso like 10x less funding than OpenAI and 100x less than MSFT, AAPL, Google, Facebook, ...
- jtonz 3y agoI think it's fair to say when you hit the hundreds of millions of dollars mark the diminishing returns for making things happen faster have well and truly kicked in. Perhaps the only benefit would be extra computational power yet I would struggle to understand the benefit of jumping from 500 million to 5 billion with such short timeframes.
- Zuiii 3y agoThe ability to truly not think about training run costs, throw random things on the wall to see what sticks. 10x resources is definitely a competitive advantage in LLM training.