3 ms·
Llama cpp speed is dramatically improved by avx instructions. If your CPU has those it would be much faster than not. And if it doesn't you need to do some wor
by jerrygenser 3y ago
Llama cpp speed is dramatically improved by avx instructions. If your CPU has those it would be much faster than not.
And if it doesn't you need to do some workarounds with compiling and it gets a bit harder to run.