No, but you can just cache the state after processing the prompt. https://github.com/ggerganov/llama.cpp/tree/master/examples/main#prompt-caching https://github

No, but you can just cache the state after processing the prompt. https://github.com/ggerganov/llama.cpp/tree/master/examples/main#prompt-caching https://github.com/ggerganov/llama.cpp/tree/master/examples/...