it's a prompt cache invalidation bug that causes all input to be reprocessed instead of getting preloaded There are other reasons to prefer vllm to llama-cpp a

it's a prompt cache invalidation bug that causes all input to be reprocessed instead of getting preloaded There are other reasons to prefer vllm to llama-cpp as well