21 ms·
See also https://github.com/thu-ml/SageAttention https://github.com/thu-ml/SageAttention and https://github.com/thu-ml/SpargeAttn https://github.com/thu-ml/Spa
by CapsAdmin 2y ago
See also
https://github.com/thu-ml/SageAttention https://github.com/thu-ml/SageAttention and
https://github.com/thu-ml/SpargeAttn https://github.com/thu-ml/SpargeAttn