3 ms·
dot-product attention is the biggest barrier. This is why there are so many attempts to linearize it.
by woadwarrior01 2y ago
dot-product attention is the biggest barrier. This is why there are so many attempts to linearize it.
- amitport 2y agothat fail... linearization is a bad idea. But plenty of other optimizations are done