3 ms·
What is truly extraordinary about that paper is that it completely ignored the fact that ML is only a tiny contributor to overall power usage in computing, and
by dekhn 5y ago
What is truly extraordinary about that paper is that it completely ignored the fact that ML is only a tiny contributor to overall power usage in computing, and also attempted to compare the training to intercontentintal flights, which use the same amount of fuel empty of full (and the planes do fly nearly empty). All of it makes it look like she just wanted to attack ML, rather than make a good faith argument.
The other part of the paper (the danger of trusting things that stochastically parrot well enough to exit the right side of the uncanny valley) is interesting.
- visarga 5y agoI think she's all to willing to throw the baby (the transformer model) with the bath water. She doesn't care about AI advancement at all, and that makes me distrust her paper.