3 ms·
Two problems with that. First, what determines whether a problem is close to solving is usually not the amount of interest in it but, rather, its hardness. See
by YeGoblynQueenne 9y ago
Two problems with that.
First, what determines whether a problem is close to solving is usually not
the amount of interest in it but, rather, its hardness. See for instance P =
NP, or the drive to find a cure for "cancer". Neither has been solved yet
despite considerable effort and investment (particularly in cancer cures). The
limitations of deep learning are a similarly hard problem- they're "baked in"
to its DNA so it's a very hard problem how to overcome them [1].
Second, yep- the field is stuck, well and truly stuck. The fact that LSTM and
CNN are 20+ years old is telling. The vast majority of ANN research today is
basically trying small tweaks to old ideas to see if something will come out
of them. There is very little incentive to research something radically
different- because people can already make a very lucrative career with little
timid architectural tweaks and researching something new and untried is risky.
So even if just throwing a lot of money and minds to a hard problem could just
make it go away, nobody is really trying. It will be a long time before a
majority of researchers recognise the limitations of deep learning and in
general statistical machine learning and do something about them.
___________________
[1] The article links to an article by François Chollet of Keras. That's the
second part of two. The first one is orders of magnitude better informed than
the article above and recommended background reading in any discussion about
the limitations of deep learning:
https://blog.keras.io/the-limitations-of-deep-learning.html https://blog.keras.io/the-limitations-of-deep-learning.html