3 ms·
You don’t have to go to that level of detail but it is still relevant. For example FlashAttention is built on optimizing for this level of detail.
by cavisne 3y ago
You don’t have to go to that level of detail but it is still relevant. For example FlashAttention is built on optimizing for this level of detail.
- TechnicolorByte 3y agoAny specifics you can describe or somewhere to read about this?
- WithinReason 3y agoJust google Flash Attention 2, first hit is the paper.