2 ms·
The usage of existing but cheaper nvidia chips to make models of similar quality is the main takeaway. So why not buy a more expensive Nvidia chip to run a bet
by aurareturn 2y ago
The usage of existing but cheaper nvidia chips to make models of similar quality is the main takeaway.
So why not buy a more expensive Nvidia chip to run a better model?
- yifanl 2y agoIs there still evidence that more compute = better model?
- aurareturn 2y agoYes. Plenty of evidence. The DeepSeek R1 model people are freaking out about, runs better with more compute because it's a chain of thoughts model.
- Vegenoid 2y agoBecause if you don't have infinite money, considering whether to buy a thing is about the ratio of price to performance, not just performance. If you can get enough performance for your needs out of a cheaper chip, you buy the cheaper chip.
- aurareturn 2y agoThe AI industry isn't pausing because DeepSeek is good enough. The industry is in an arms race to AGI. Having a more efficient method to train and use LLMs only accelerates progress, leading to more chip demand.
- ozgrakkurt 2y agoThere is no indication that adding more compute will give AGI