3 ms·
> For instance, according to [1], training a single big NLP model can burn up to 620,000 lbs of CO2. That's not 'an NLP model', it's one of the largest and ba
by visarga 7y ago
> For instance, according to [1], training a single big NLP model can burn up to 620,000 lbs of CO2.
That's not 'an NLP model', it's one of the largest and baddest NLP models that has to be trained only once and can be reused 1000 times over by fine-tuning on different tasks. The paper was hyperbolising about energy use. The AI labs that can even attempt that kind of things can be counted on the fingers of one hand.
A regular NLP model trains in minutes up to a day on a single GPU, so it uses energy on the level of personal game play. And let's not forget that ML can solve difficult math problems with as little as 1/100 of the energy of classical computing by using smart approximation methods. Neural nets also have a nice degradation effect where you can shrink the net by 20x and lose just a few percentage points of accuracy.
That's why Google's speech recognition and synthesis can now run on a single cell phone instead of a datacenter. And we haven't really started building specialised AI chips that will reduce energy usage even further - we're still using mostly GPUs.
- TeMPOraL 7y ago> That's why Google's speech recognition and synthesis can now run on a single cell phone instead of a datacenter. Can it? I thought it still sent out input to the cloud for processing?
- baq 7y agocheck if it works in airplane mode, it might on new hardware
- AstralStorm 7y agoWith junk performance that's not even passable. It's a different model.