3 ms·
FlashAttention has memory linear in sequence length. https://github.com/HazyResearch/flash-attention https://github.com/HazyResearch/flash-attention
by jph00 3y ago
FlashAttention has memory linear in sequence length.
https://github.com/HazyResearch/flash-attention https://github.com/HazyResearch/flash-attention