3 ms·
It does, for anybody who studied math at the level you need to understand Attention (some linear algebra). Please no low effort comments, ask if you don't have
by mrks_hy 1y ago
It does, for anybody who studied math at the level you need to understand Attention (some linear algebra).
Please no low effort comments, ask if you don't have the math background and people will gladly help. This is sum notation, see https://en.m.wikipedia.org/wiki/Summation https://en.m.wikipedia.org/wiki/Summation
- auggierose 1y agoNo, it doesn't really clarify things. I had the best linear algebra grades in my year at my university, and if you don't know anything about kernels, this is not helpful (what are xi and yi in the first place?).
- lambdasquirrel 1y agoIt's all described in the referenced link. No need for everyone to get antsy. > 0. http://bactra.org/notebooks/nn-attention-and-transformers.ht http://bactra.org/notebooks/nn-attention-and-transformers.ht...