2 ms·
this is the same concept as the bitter lesson, am I correct? I don't see a substantial difference yet.
by golol 3y ago
this is the same concept as the bitter lesson, am I correct? I don't see a substantial difference yet.
- dekhn 3y agoI hadn't read that before, but yes. Sutton focuses mostly on "large amounts of compute" whereas I think his own employer has demonstrated that it's a combination of large amount of compute, large amounts of data, and really clever probabilistic algorithms, in combination, which really demonstrate the utility of the bitter lesson. And speaking as a biologist for a moment, that minds are irredeemably complex and attemptng to understand them with linear, first-order rules and logic is unlikely to be fruitful.