3 ms·
https://www.reddit.com/r/LocalLLaMA/comments/1gpr2p4/llms_cost_is_decreasing_by_10x_each_year_for/ https://www.reddit.com/r/LocalLLaMA/comments/1gpr2p4/llms_co.
by onlyrealcuzzo 4mo ago
https://www.reddit.com/r/LocalLLaMA/comments/1gpr2p4/llms_cost_is_decreasing_by_10x_each_year_for/ https://www.reddit.com/r/LocalLLaMA/comments/1gpr2p4/llms_co...
See Chart 13 here: https://www.rdworldonline.com/ais-great-compression-20-charts-show-vanishing-gaps-but-still-soaring-costs/ https://www.rdworldonline.com/ais-great-compression-20-chart...
See here: https://epoch.ai/data-insights/llm-inference-price-trends https://epoch.ai/data-insights/llm-inference-price-trends
LLMs are so comically inefficient compared to the human brain that it is pretty easy to imagine this trend continuing for several more 90% drops.
If LeCun's JEPA or GRAM turn out to be a thing, we could see a 3-4 order of magnitude drop in a single release cycle / generation.
Keep in mind that performance per watt on the hardware side - at the same time - is still doubling every ~24 months - and this doesn't factor that in.
- dingnuts 4mo ago[dead]