3 ms·
llama.cpp clearly does not support iSWA: https://github.com/ggml-org/llama.cpp/issues/12637 https://github.com/ggml-org/llama.cpp/issues/12637 Ollama does, ple
by nolist_policy 1y ago
llama.cpp clearly does not support iSWA: https://github.com/ggml-org/llama.cpp/issues/12637 https://github.com/ggml-org/llama.cpp/issues/12637
Ollama does, please try it.