3 ms·
Flash attention gets this down to linear time complexity with no loss of quality.
by Der_Einzige 4y ago
Flash attention gets this down to linear time complexity with no loss of quality.
- sebzim4500 4y agoNo it doesn't, it just improves the constant factor by a lot. Unless you are thinking of block sparse attention, which can chance complexity (assuming you scale sparsity with size) but decreases quality.