I am not sure about llama.cpp but it works with Ollama. That's not to say won't need to tweak things when you cut down to smaller models, there are always trad

I am not sure about llama.cpp but it works with Ollama. That's not to say won't need to tweak things when you cut down to smaller models, there are always trade offs swapping models.