4 ms·
The goal here is to actually understand the mechanics of the model and begin the process of intuitively understanding the space. I would put the effort here at
by nikhizzle 3y ago
The goal here is to actually understand the mechanics of the model and begin the process of intuitively understanding the space. I would put the effort here at a few weekends of focus.
Also will add the models turned out to be a lot simpler to understand than I expected going in.
- spmurrayzzz 3y agoIf developing intuitions is the goal, I really do think Jay Alammar's "Illustrated Transformer" [1] is at least a step function better in the service of that outcome than the academic paper itself. (I totally realize this is subjective, but that has been my experience with my own learning in the space over the last few years as well as some folks I've mentored) http://jalammar.github.io/illustrated-transformer/ http://jalammar.github.io/illustrated-transformer/