2 ms·
>This position paper advocates a practical solution by making efficiency an evaluation criterion for research alongside accuracy and related measures. In additi
by 6gvONxR4sf7o 7y ago
>This position paper advocates a practical solution by making efficiency an evaluation criterion for research alongside accuracy and related measures. In addition, we propose reporting the financial cost or "price tag" of developing, training, and running models to provide baselines for the investigation of increasingly efficient methods.
[emphasis mine]
They suggest reporting cost metrics next to benefit metrics so readers can judge the tradeoff for themselves. There's no proposal to ignore the benefits.
- gwern 7y agoAnd, as I already pointed out, none of their suggests cost metrics are even close to a total cost, and many of them are seriously misleading, and they use them in misleading rhetorical ways (as I noted about their bogus estimates of CO2 emissions). Everything about this paper, from the name 'green AI' on down, is framed to put sole attention on a narrow arbitrary section of costs of political relevance, at the cost of a holistic evaluation. A single vague clause about 'other measures' doesn't change that, no matter how you italicize it. Motte-and-bailey.