28 ms·
I'm running a30-a3b-instruct q6 quant on exllamav2 and checked few simple tasks in roo and cline. Prompt adherence, tool calling and file changing worked flawle
by eurekin 1y ago
I'm running a30-a3b-instruct q6 quant on exllamav2 and checked few simple tasks in roo and cline. Prompt adherence, tool calling and file changing worked flawlessly
- faangguyindia 1y agookay turns out i was using it in aider with wrong edit format in editor mode, i switched to editor edit format it has not failed so far.
- wickedsight 1y agoMaybe I'm doing something wrong, but in my testing with Roo and Qwen3-Coder-30B via MLX, it constantly ends up in loops and often doesn't manage to finish editing a file, leaving it half finished. If I give it really simple, straight forward tasks it works quite nice though.