2 ms·
I mean, sure you can work around it, but from your own link: >since the time and memory complexity of self-attention are quadratic in sequence length
by RC_ITR 3y ago
I mean, sure you can work around it, but from your own link:
>since the time and memory complexity of self-attention are quadratic in sequence length
- why_only_15 3y agoExcept in practice this is not true, and hasn't been for more than a year. It's not just a workaround either -- FlashAttention is both faster at runtime and uses less memory.
- deleted 3y ago[deleted]