3 ms·
>> At this point, I'm not sure whether you disagree with that, or just think that some hype could afford to fade (no argument!). I think I agree. I believe the
by YeGoblynQueenne 8y ago
>> At this point, I'm not sure whether you disagree with that, or just think that some hype could afford to fade (no argument!).
I think I agree. I believe the hype is primarily driven by industry looking for applications rather than researchers looking for, er, well, understanding, hopefully.
>> Because of that, I was slower than I could have been to recognize the feedback loops in what is "true" about applied AI. Deep learning's initial fit for some architectures and problems has attracted attention that made it much cheaper and easy to experiment, and therefore useful for more and more - even gobbling up adjacent techniques and giving them new names (over any manner of academic protest). That feedback loop isn't unbounded, but I guess I'm just sharing the perspective that hype, while annoying, isn't something that even a grad student can afford to disdain.
You're right of course. Deep learning has earned its due respect I think and although I expect the field to look for something new eventually, I'm guessing that CNNs and LSTMs in particular will remain as established techniques, probably incorporated into other work. I mean, until some new technique comes up that can match CNNs' accuracy but with much improved sample efficiency and generalisation, CNNs are going to remain the go-to method for image classification.
Like, I don't disdain deep learning, I did some work with LSTMs for my Master's and I'm thinking of using CNNs for some vision stuff after my PhD (my subject woulnd't really fit). It's just, there's so many people publishing on deep learning right now that I don't see the point of joining in myself.
- evrydayhustling 8y agoLooks like you are doing some cool stuff based on learning of structures! And indeed, the folks who are now celebrated for DNNs were doing the less popular thing for 10-20y prior :) Best of luck on your research.
- YeGoblynQueenne 8y agoAh, I've been telling myself that, yes. Cheers :)