3 ms·
Flash attention natively supports packing multiple variable length sequences into a single call, what is the advantage of jagged flash attention?
by platers 2y ago
Flash attention natively supports packing multiple variable length sequences into a single call, what is the advantage of jagged flash attention?
- deleted 2y ago[deleted]
- bbstats 2y agoIf only there was a link to a page somewhere that could answer this question for you.