3 ms·
Is there an article that would meet your standard (discusses transformers, uses the word 'attention') that you could give to someone who has no familiarity with
by dado3212 4y ago
Is there an article that would meet your standard (discusses transformers, uses the word 'attention') that you could give to someone who has no familiarity with computer science?
- seydor 4y agoJay alammar's Illustrated transformer, although this too is detailed. I think it's still worth taking a look, because really i don't think that people have yet "compressed" what transformers do intuitively. None of the concepts of the networks are particularly hard math - it's basic algebra. But the overall construction is complicated. https://jalammar.github.io/illustrated-transformer/ https://jalammar.github.io/illustrated-transformer/