3 ms·
No (at least, not the version I read a few years ago). But transformers are a specific neural network architecture, so I’d still recommend the book for the fund
by nmfisher 6y ago
No (at least, not the version I read a few years ago). But transformers are a specific neural network architecture, so I’d still recommend the book for the fundamentals around backpropagation, activation & loss functions, etc.
Once you’re comfortable with neural networks (and the notation), the “Attention is all you need” paper is fairly accessible.
- mrfusion 6y ago> Once you’re comfortable with neural networks (and the notation) I think I am actually. And I read attention is all you need. (Well half of it) and it didn’t seem to delve into how they work.
- blackbear_ 6y agoIt really does, read section 3 carefully. As for why they work so well, that's still an open question.