3 ms·
Thanks! The 0.1B version looks perfect for embedded system. What is the key benefit of attention-free architecture?
by low_tech_punk 2y ago
Thanks! The 0.1B version looks perfect for embedded system. What is the key benefit of attention-free architecture?
- pico_creator 2y agolower compute cost especially over longer sequence length. Depending on context length, its 10x, 100x, or even 1000x+ cheaper. (quadratic vs linear cost difference)