3 ms·
I am pretty sure llamacpp have their own benchmarking binary that you can use.
by anon-3988 5mo ago
I am pretty sure llamacpp have their own benchmarking binary that you can use.
- mft_ 5mo agollama-bench is part of the llama-cpp package, but from recent experimentation, the settings it is able to (or is documented to?) accept lag behind somewhat. Not sure whether it would accept all of the esoteric settings in the article?