3 ms·
if it's anything like the speeds Nvidia Nim puts Deepseek at, it'll probably be 10 tok/s or lower and timeout frequently
by nateb2022 3mo ago
if it's anything like the speeds Nvidia Nim puts Deepseek at, it'll probably be 10 tok/s or lower and timeout frequently