2 ms·
Flash attention is an implementation trick; you can implement MHA/GQA, for example, with flash attention.
by apophis-ren 2y ago
Flash attention is an implementation trick; you can implement MHA/GQA, for example, with flash attention.
loading thread…