3 ms·
llama.cpp and llama-swap do this better than Ollama and with far more control.
by rubiquity 7mo ago
llama.cpp and llama-swap do this better than Ollama and with far more control.
- circularfoyers 7mo agoDon't even need to use llama-swap anymore now that llama-server supports the same functionality.
- rubiquity 7mo agoI did not know that. Thanks for sharing!