3 ms·
https://arxiv.org/abs/2207.09238 https://arxiv.org/abs/2207.09238 This is a great transparent and clear description of what is actually going on in attention l
by tomasff 3y ago
https://arxiv.org/abs/2207.09238 https://arxiv.org/abs/2207.09238
This is a great transparent and clear description of what is actually going on in attention layers.
Alternatively, this article by Jay Alammar is also very popular
http://jalammar.github.io/illustrated-transformer/ http://jalammar.github.io/illustrated-transformer/
- opyate 3y agoI commented yesterday, but came back to say this. Just found it, and it's really good. I like reading descriptions better than watching videos of them, so this is great.