4 ms·
"--context-shift, --no-context-shift ... whether to use context shift on infinite text generation (default: disabled)" From: https://github.com/ggml-org/llama.
by pulse7 2mo ago
"--context-shift, --no-context-shift ... whether to use context shift on infinite text generation (default: disabled)"
From: https://github.com/ggml-org/llama.cpp/blob/master/tools/server/README.md https://github.com/ggml-org/llama.cpp/blob/master/tools/serv...
- MrDrMcCoy 2mo agoThat is obvious. Less obvious is what context shifting does and whether you want it or not.