3 ms·
>> Examples of elegance in deep learning: The gating mechanisms of LSTMs (also adds to interpretability); LSTMS amaze and dumbfound me in equal measures and I
by YeGoblynQueenne 10y ago
>> Examples of elegance in deep learning: The gating mechanisms of LSTMs (also adds to interpretability);
LSTMS amaze and dumbfound me in equal measures and I admire anyone who can understand them, at all.
Could you please indulge my cluelessness and explain to me what is mathematically elegant about the gating mechanism in LSTMs and how it adds to interpretability?
- andrew3726 10y agoYou might like this article[0]. It definitely helped me develop some intuition for LSTMs. 0: http://r2rt.com/written-memories-understanding-deriving-and-extending-the-lstm.html http://r2rt.com/written-memories-understanding-deriving-and-...
- YeGoblynQueenne 10y agoThanks, but I wanted to hear why the OP thinks LSTM gates are elegant and add to interpretability. The OP made a big todo about how the article above is misguided and the person who wrote it has a poor understanding of deep learning, so I'm assuming he or she has a very good understanding of the subject. I mean, I'd hate to believe the OP is just playing deep learning bingo for HN karma, you know?