3 ms·
> 140Wh are needed to write a 100-word email, equivalent to 7 full charges of an iPhone Pro Max. An iPhone can write a whole email in a few seconds using a loc
by Retr0id 2y ago
> 140Wh are needed to write a 100-word email, equivalent to 7 full charges of an iPhone Pro Max.
An iPhone can write a whole email in a few seconds using a local model.
- dkdbejwi383 2y agothe local model needs to be trained beforehand though, right? And that's where a lot of the energy and water consumption comes from.
- Retr0id 2y agoThey cite consumption during training as a separate bullet point.
- Retr0id 2y agoWhich, to be honest, is probably worse. When it comes to AI, I'm a lot more worried about "information pollution" than anything else.
- nh23423fefe 2y agoWeird to be worried about a metaphor instead of something real?
- Retr0id 2y agoWhat makes it not real?
- nh23423fefe 2y agoImagining that information exists in some pure unvarnished state (like a pristine mountain lake), until it is polluted by some bad actor (big bad logging company). The metaphor doesn't work at all. It just more "the truth is under attack"
- planb 2y agoExactly what I thought when reading this. And that's the moment I stop taking the (probably somewhat valid) claims seriously. This reminds me of the arguments against streaming we had a few years ago, that confused compression/decompression, completely disregarded local caching and calculated as if all network infrastructure in the world was just being used for streaming.
- arresin 2y agoIt’s not going to be a good email.
- alganet 2y agoAwesome. We don't need server AI of any kind then. Always good to have user feedback. You heard him folks, lets turn off the big servers, local low power models are good enough.