This reddit thread: https://www.reddit.com/r/LocalLLaMA/comments/1dhx449/deepseekcoderv2_breaking_the_barrier_of/ https://www.reddit.com/r/LocalLLaMA/comments/

This reddit thread: https://www.reddit.com/r/LocalLLaMA/comments/1dhx449/deepseekcoderv2_breaking_the_barrier_of/ https://www.reddit.com/r/LocalLLaMA/comments/1dhx449/deepsee... links to two GGUFs: https://huggingface.co/bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF https://huggingface.co/bartowski/DeepSeek-Coder-V2-Lite-Inst... https://huggingface.co/LoneStriker/DeepSeek-Coder-V2-Lite-Instruct-GGUF https://huggingface.co/LoneStriker/DeepSeek-Coder-V2-Lite-In... Apparently both require disabling flash attention.