IpsumDominum

3 ms·

1. 1.▲
   by IpsumDominum 5y ago

   Perhaps I'd add a small script with different type of generating functions, thanks for the suggestion. Me too :) For educational/reference purposes, there's a lot of complexity which can be introduced which is irrelevant to t
2. 2.▲
   by IpsumDominum 5y ago

   What motivated me to write it is due to, as I am trying to learn about the transformer myself, not being able to find a very simple reference to transformers. The annotated transformer ( https://nlp.seas.harvard.edu/2018&#x2F
3. 3.▲
   by IpsumDominum 5y ago

   Yet another implementation of "attention is all you need paper", hopefully easier(relatively) to understand. Please point out any mistakes :)
4. 4.▲
   A Simple Transformer Implementation(PyTorch) Without Difficult Syntax(github.com)

   28 points by IpsumDominum 5y ago|6 comments