3 ms·
I think it will be a good thing for other reasons: there will be a massive push to get hardware good enough to run local LLMs burning infinite tokens.
by deadbabe 2mo ago
I think it will be a good thing for other reasons: there will be a massive push to get hardware good enough to run local LLMs burning infinite tokens.
- alainrk 2mo agoYeah but energy is still a cost, and local inference without batch and multiplexing for many users (like an office would be) is even less optimal. I'm not sure I think it's just pushing the problem forward
- deadbabe 2mo agoThen there will also be a push for cheaper, freer energy as well.
- yladiz 2mo agoYeah, with all the AI needs we’ll just have to transition to fusion energy.
- deadbabe 2mo agoAnd geothermal. Not even for the environmental aspects, just purely from energy demands, at any spot on the Earth where a data center could go.
- Geezus_42 2mo agoHahahahaha sorry, that's hilarious.