3 ms·
How does this bench compared to MLX?
by zdw 1y ago
How does this bench compared to MLX?
- jasonjmcghee 1y agoI use MLX in lmstudio and it doesn't have whatever issues llama cpp is showing here. Qwen3-0.6B at 5 t/s doesn't make any sense. Something is clearly wrong for that specific model.