3 ms·
You are misinterpreting the bitter lesson, it only gets more bitter with time! The arxiv paper is well written, worth a read.
by sitkack 2y ago
You are misinterpreting the bitter lesson, it only gets more bitter with time!
The arxiv paper is well written, worth a read.
- ahartmetz 2y agoI don't think that I misunderstood - it says that more computing power beats "hand-engineering". But more computing power doesn't seem to work that well anymore to improve AI performance - and there is not much more computing power coming in the next couple of years, not orders of magnitude more for free like it used to be. Case in point: the somewhat disappointing new nVidia generation.
- sitkack 2y ago> it says that more computing power beats "hand-engineering". This is the simplistic tl;dr, but that isn't what is says. You should reread the essay and the linked arxiv paper. It is much more than throwing more compute at a problem.