5 ms·
All these transformer explainqtions are missing a level of detail. I wish someone would code this model and walk through it along with the training and inferen
by ipunchghosts 6y ago
All these transformer explainqtions are missing a level of detail.
I wish someone would code this model and walk through it along with the training and inference procedures.
- deeplstm 6y agoI did skip many details in this video as Transformer architecture is itself a big topic. I would suggest breaking down this paper into 2 components. 1. Transformer 2. How to apply the Transformer to image data As for the first one, I made a video to go through Transformer architecture, if you're interested https://youtu.be/ELTGIye424E https://youtu.be/ELTGIye424E For the second one, what you need to code except for the Transformer is a pre-processing pipeline to break an image into a sequence of patches.