3 ms·
Going to leave this here: https://cacm.acm.org/blogcacm/the-energy-footprint-of-humans-and-large-language-models/#:~:text=LLMs%20generate%20tokens%2C%20parts%20
by chrissssdotcom 2y ago
Going to leave this here:
https://cacm.acm.org/blogcacm/the-energy-footprint-of-humans-and-large-language-models/#:~:text=LLMs%20generate%20tokens%2C%20parts%20of%20words%2C%20so%20if,1%2C332%20Joules%20for%20333%20tokens%2C%20about%200.00037%20kWh https://cacm.acm.org/blogcacm/the-energy-footprint-of-humans....
This is such a waste of power, using an LLM is bad enough (but at least it's a valid use of power), but using all of them at once for each question is ridiculous.