3 ms·
The test vectors idea is pretty interesting! That's a good one. I haven't been able to try out QwQ locally yet. There seems to be something wrong with this mod
by anon373839 2y ago
The test vectors idea is pretty interesting! That's a good one.
I haven't been able to try out QwQ locally yet. There seems to be something wrong with this model on Ollama / my MacBook Pro. The text generation speed is glacial (much, much slower than, say Qwen 72B at the same quant). I also don't see any MLX versions on LM Studio yet.