I’d recommend reading the paper “Attention is all you need” as it lays a lot of the foundational knowledge about transformers. I’m no math guru, so I had to re

I’d recommend reading the paper “Attention is all you need” as it lays a lot of the foundational knowledge about transformers. I’m no math guru, so I had to read the paper like 5 or 6 times to wrap my head around it. I had to stop trying to understand how the math worked exactly and just accepted that it did, then it started to make sense. Now going back I can actually understand some of why the math works.