4 ms·
I was hoping this would be more comprehensive, breaking down the transformer architecture as well. Anyone got a resource like this?
by inertiatic 7y ago
I was hoping this would be more comprehensive, breaking down the transformer architecture as well. Anyone got a resource like this?
- ma2rten 7y agoHere you go: http://www.peterbloem.nl/blog/transformers http://www.peterbloem.nl/blog/transformers
- inertiatic 7y agoWow, I didn't expect such a detailed write up that is still meant for people without a great overview of all the advancements leading up to this. I'll certainly start digging into this tonight.
- liuliu 7y agoAlso: https://nlp.seas.harvard.edu/2018/04/03/attention.html https://nlp.seas.harvard.edu/2018/04/03/attention.html
- inertiatic 7y agoThank you, this also seems great although more of a practical resource it seems. I'll go through this after I have a base intuition from the other resource.