4 ms·
It's clearly important but I found that paper hard to follow. The discussion in AIMA 4th edition was clearer. (Is there an even better explanation somewhere?)
by abecedarius 6y ago
It's clearly important but I found that paper hard to follow. The discussion in AIMA 4th edition was clearer. (Is there an even better explanation somewhere?)
- 6gvONxR4sf7o 6y agoIt's crazy to me to see what still feel like new developments (come on, it was just 2017!) making their way into mainstream general purpose undergraduate textbooks like AIMA. It's this what getting old feels like? :-\ I start to understand what you always hear from older ICs about having to work to keep up, or else every undergrad coming out will know things you don't.
- glial 6y agoI found it difficult to read too. Here's an annotated version, with code, which helps: https://nlp.seas.harvard.edu/2018/04/03/attention.html https://nlp.seas.harvard.edu/2018/04/03/attention.html