3 ms·
Perhaps your card has less per-SM shared memory than the GPUs DeepSeek uses. Try to lower the sm90_capacity value in gemm.py: I think 128KB is the correct valu
by devit 2y ago
Perhaps your card has less per-SM shared memory than the GPUs DeepSeek uses.
Try to lower the sm90_capacity value in gemm.py: I think 128KB is the correct value for RTX 5080 compared to 256KB for the H100/H800.
And probably add ", 3, 2, 1" after "6, 5, 4".