4 ms·
The ideas are orthogonal, and can be used (theoretically) at the same time.
by ipsum2 3y ago
The ideas are orthogonal, and can be used (theoretically) at the same time.
- scv119 3y agoI believe you can slightly change the flash attention kernel to implement the same kernel of this page attention, since both of them work on the key/value cache at block level.