2 ms·
> Progress in AI is not coming from abstract reasoning. It is coming from an increase in raw power Maybe it's a bit of both. Sure, large DL models use lots of
by credit_guy 6y ago
> Progress in AI is not coming from abstract reasoning. It is coming from an increase in raw power
Maybe it's a bit of both. Sure, large DL models use lots of compute, but successful DL applications require some insight into the problem. For some reason, people like to de-emphasize this insight. The story is that a DL model will discover by itself which features are important, which are not, and you just provide the training data, and press a button. Thousands of people do just that, and end up with mediocre results. Thousands and thousands of absolutely mediocre papers get published, and receive acclaim instead of derision.
The truly boundary shifting results always use deep insight. Like what comes out of DeepMind (AlphaGo, AlphaZero, AlphaFold).