4 ms·
The amount of computation in the world devoted to deep learning, in aggregate, might be a small slice of total computation. But in terms of costs borne by indiv
by mrtranscendence 3y ago
The amount of computation in the world devoted to deep learning, in aggregate, might be a small slice of total computation. But in terms of costs borne by individual organizations who train such models, deep learning could be extremely substantial. Particularly if it takes millions in additional investment to achieve only marginal reductions in error.
- dekhn 3y agoHow is that different from any other capital-intensive industry. Basically my point is that there is nothing specific to DL in these articles/complaints, people are just jumping on the bandwagon.
- mrtranscendence 3y agoFor me, the takeaway is that training state of the art models may become cost prohibitive even for large companies. There may be a practical limit to how complex models can become. This is at least plausibly interesting to know.