3 ms·It will be Seconds Per Token instead of Tokens Per Second.by imrebuild 5mo agoIt will be Seconds Per Token instead of Tokens Per Second.lostmsu 5mo ago2 s/t on to NVMes The issue is KV cache