3 ms·
Transformer Inference Arithmetic
- tbarton16 5y agoWow! so helpful! I love the illustrations.
- iandanforth 5y agoThis is one of the more practical and useful articles I've read about ML in practice. Going through these calculations feels much more like solid engineering vs the hand-wavy 'use a different model' or 'have you tried model distillation' type performance discussions I see elsewhere.