3 ms·
I tend to think this will end up being a good thing. It will force people to actually think about the best use cases and utilization of tokens while others will
by Aboutplants 2mo ago
I tend to think this will end up being a good thing. It will force people to actually think about the best use cases and utilization of tokens while others will push to optimize models and tools to improve cost and efficiency. “Life finds a way”
- deadbabe 2mo agoI think it will be a good thing for other reasons: there will be a massive push to get hardware good enough to run local LLMs burning infinite tokens.
- alainrk 2mo agoYeah but energy is still a cost, and local inference without batch and multiplexing for many users (like an office would be) is even less optimal. I'm not sure I think it's just pushing the problem forward
- deadbabe 2mo agoThen there will also be a push for cheaper, freer energy as well.
- yladiz 2mo agoYeah, with all the AI needs we’ll just have to transition to fusion energy.
- deadbabe 2mo agoAnd geothermal. Not even for the environmental aspects, just purely from energy demands, at any spot on the Earth where a data center could go.
- Geezus_42 2mo agoHahahahaha sorry, that's hilarious.