4 ms·
I gave a talk on using Google BERT for financial services problems at a machine learning conference in early 2019. During my preparation, this was the only res
by ryan-duve 2y ago
I gave a talk on using Google BERT for financial services problems at a machine learning conference in early 2019. During my preparation, this was the only resource on transformers I could find that was even remotely understandable to me.
I had a lot of trouble understand what was going on from just the original publication[0].
[0] https://arxiv.org/abs/1706.03762 https://arxiv.org/abs/1706.03762
- andoando 2y agoMaybe Im dumb but I still can't make much sense of this.
- deleted 2y ago[deleted]
- isaacfung 2y agoMaybe it's easier to understand in the format of annotated code https://nlp.seas.harvard.edu/2018/04/03/attention.html https://nlp.seas.harvard.edu/2018/04/03/attention.html
- ronald_petty 2y agoUpdated (in case above link goes away) - https://nlp.seas.harvard.edu/annotated-transformer/ https://nlp.seas.harvard.edu/annotated-transformer/ Thanks for original!