2 ms·
So where are the recent improvements in LLMs proportional to the billions invested?
by ahartmetz 1y ago
So where are the recent improvements in LLMs proportional to the billions invested?
- dcre 1y agoValue for the money is not at issue in the paper!
- ahartmetz 1y agoI believe it is. They are saying that LLMs don't improve all that much from giving them more resources - and computing power (and input corpus size) is pretty proportional to money.
- BoredPositron 1y agoIt's not about value it's about the stagnation while throwing compute at the problem.
- dcre 1y agoExactly.