2 ms·
What runtime are you using with the 2x RTX Pro 6000 Blackwell machine? I have the same setup and tried DSv4 Flash on vLLM and ran into a ton of kernel bugs that
by namr2000 2mo ago
What runtime are you using with the 2x RTX Pro 6000 Blackwell machine? I have the same setup and tried DSv4 Flash on vLLM and ran into a ton of kernel bugs that don't seem to have been fixed yet.
- deleted 2mo ago[deleted]
- mshachkov 2mo agoThis one works great. https://github.com/ormandj/sglang-deepseek-v4-flash-sm120 https://github.com/ormandj/sglang-deepseek-v4-flash-sm120
- natsucks 2mo agoso..you guys have $20k+ rigs?
- complex1314 2mo agoThis also works great: https://github.com/antirez/ds4 https://github.com/antirez/ds4