2 ms·
> Last I checked Ollama inference is based on llama.cpp Yes and no. They've written their own "engine" using GGML libraries directly, but fall back to llama.cp
by magicalhippo 1y ago
> Last I checked Ollama inference is based on llama.cpp
Yes and no. They've written their own "engine" using GGML libraries directly, but fall back to llama.cpp for models the new engine doesn't yet support.