3 ms·My best suggestion is use axoltol to tune, convert to HF format with llama.cpp, and serve with Ollama.by Carrok 2y agoMy best suggestion is use axoltol to tune, convert to HF format with llama.cpp, and serve with Ollama.