2 ms·
>Current top models are measured in hundreds of billions of parameters. Future models will have many trillions It wont matter. These have diminishing returns.
by coldtea 2y ago
>Current top models are measured in hundreds of billions of parameters. Future models will have many trillions
It wont matter. These have diminishing returns.
And, for LLM style AI, the corpuses aren't getting any bigger. Instead the get more polluted and self-referential.
- pseudosavant 2y agoYou could say that RAM has had diminishing returns. My laptop has 26,214x the RAM of my original PC. It is certainly way more capable, but is it 26,214x more capable? After all, diminishing returns are still returns. I still think that Anthropic's latest mini model performing better than their best model from 12-months ago suggests that we are far from meaningfully diminishing returns.