3 ms·
But at what cost? We're in an energy/environmental crisis, and we're replacing simple pipelines with (unreliable) gas factories?
by Yoric 2y ago
But at what cost?
We're in an energy/environmental crisis, and we're replacing simple pipelines with (unreliable) gas factories?
- galgia 2y agoLLMs are not the most efficient way to solve the problem, but they can solve it.
- Yoric 2y agoThey can do it, they're just slower, less reliable and orders of magnitude more energy-expensive. But yes, they're potentially easier to setup.
- danielbln 2y agoCost per token has cratered a thousand percent over the last two years, and that's not just lighting VC on fire, efficiency gains are made left and right.
- Yoric 2y agoHow much do we need to progress before it becomes comparable in terms of energy to the (often already rather energy-inefficient) data pipelines we've been using so far? Recall that while the cost per token may decrease, CoT multiplies the number of tokens by several orders of magnitude.