3 ms·
I did skip many details in this video as Transformer architecture is itself a big topic. I would suggest breaking down this paper into 2 components. 1. Transfo
by deeplstm 6y ago
I did skip many details in this video as Transformer architecture is itself a big topic. I would suggest breaking down this paper into 2 components.
1. Transformer
2. How to apply the Transformer to image data
As for the first one, I made a video to go through Transformer architecture, if you're interested
https://youtu.be/ELTGIye424E https://youtu.be/ELTGIye424E
For the second one, what you need to code except for the Transformer is a pre-processing pipeline to break an image into a sequence of patches.