2 ms·
As the article describes, most of this was done with llama.cpp, not Ollama.
by mkl 1y ago
As the article describes, most of this was done with llama.cpp, not Ollama.
- syntaxing 1y agoAhh good catch, I didn’t notice if you scroll lower, he has the llama cpp results. The ollama-benchmark repo name is a misnomer.
- geerlingguy 1y agoI'm slowly migrating all my testing to https://github.com/geerlingguy/beowulf-ai-cluster https://github.com/geerlingguy/beowulf-ai-cluster