6 ms·
Give it a day or two and the 'unsloth' people will probably publish a Q6 and Q8 (maybe Q8XL?) quantization in GGUF format for llama-server and other users.
by walrus01 4mo ago
Give it a day or two and the 'unsloth' people will probably publish a Q6 and Q8 (maybe Q8XL?) quantization in GGUF format for llama-server and other users.
- khimaros 4mo agothey have arrived: https://huggingface.co/unsloth/Qwen-AgentWorld-35B-A3B-GGUF https://huggingface.co/unsloth/Qwen-AgentWorld-35B-A3B-GGUF