3 ms·
The smaller of the two models is open weights and available on Huggingface: https://huggingface.co/Qwen/Qwen-AgentWorld-35B-A3B https://huggingface.co/Qwen/Qwe
by adrian_b 4mo ago
The smaller of the two models is open weights and available on Huggingface:
https://huggingface.co/Qwen/Qwen-AgentWorld-35B-A3B https://huggingface.co/Qwen/Qwen-AgentWorld-35B-A3B
- walrus01 4mo agoGive it a day or two and the 'unsloth' people will probably publish a Q6 and Q8 (maybe Q8XL?) quantization in GGUF format for llama-server and other users.
- khimaros 4mo agothey have arrived: https://huggingface.co/unsloth/Qwen-AgentWorld-35B-A3B-GGUF https://huggingface.co/unsloth/Qwen-AgentWorld-35B-A3B-GGUF
- npodbielski 4mo agoI tried to run it but seems like it is either broken or it does not work on dockerized llama.cpp: 0.01.865.326 E llama_model_load: error loading model: missing tensor 'blk.40.attn_norm.weight'
- khimaros 4mo agothat particular quant is just corrupted. these work but seem to loop in reasoning a lot https://huggingface.co/groxaxo/Qwen-AgentWorld-35B-A3B-GGUF https://huggingface.co/groxaxo/Qwen-AgentWorld-35B-A3B-GGUF
- npodbielski 4mo agounsloth version works.