3 ms·
Top K sampling comes to mind, although it's nowhere nearly as important as matmult.
by woadwarrior01 1y ago
Top K sampling comes to mind, although it's nowhere nearly as important as matmult.
- almostgotcaught 1y agoranking models benefit from gpu impls of sort but yup they're not nearly as common/important as spmm/spmv