3 ms·

Do you point claude code to this? The orchestration seems to be very important.

teaearlgraycold 7mo ago
I loaded Qwen into LM Studio and then ran Oh My Pi. It automatically picked up the LM Studio API server. For some reason the 35B A3B model had issues with Oh My Pi's ability to pass a thinking parameter which caused it to crash. 27B did not have that issue for me but it's much slower. Here's how I got the 35B model to work: https://gist.github.com/danthedaniel/c1542c65469fb1caafabe1371e8ed445 https://gist.github.com/danthedaniel/c1542c65469fb1caafabe13... The 35B model is still pretty slow on my machine but it's cool to see it working.
badgersnake 7mo ago
I’ve tried it on Claude code, Found it to be fairly crap. It got stuck in a loop doing the wrong thing and would not be talked out of it. I’ve found this bug that would stop it compiling right after compiling it, that sort of thing. Also seemed to ignore fairly simple instructions in CLAUDE.md about building and running tests.
tommyjepsen 7mo ago
I ran the Qwen3 Coder 30B through LM Studio and with OpenCode(Instead of Claude code). Did decent on M4 Max 32GB. https://www.tommyjepsen.com/blog/run-llm-locally-for-coding https://www.tommyjepsen.com/blog/run-llm-locally-for-coding
andsoitis 7mo ago
I use Claude Code for agentic coding but it is better to use qwen3-coder in that case. It qwen3-coder is better for code generation and editing, strong at multi-file agentic tasks, and is purpose-built for coding workflows. In contrast, qwen3.5 is more capable at general reasoning, better at planning and architecture decisions, good balance of coding and thinking.
Aurornis 7mo ago
The 9B models are not useful for coding outside of very simple requests. Qwen3.5 is confusing a lot of newcomers because it is very confident in the answers it gives. It can also regurgitate solutions to common test requests like “make a flappy bird clone” which misleads users into thinking it’s genetically smart. Using the Qwen3.5 models for longer tasks and inspecting the output is a little more disappointing. They’re cool for something I can run locally but I don’t agree with all of the claims about being Sonnet-level quality (including previous Sonnet versions) in my experience with the larger models. The 9B model is not going to be close to Sonnet in any way.

I loaded Qwen into LM Studio and then ran Oh My Pi. It automatically picked up the LM Studio API server. For some reason the 35B A3B model had issues with Oh My Pi's ability to pass a thinking parameter which caused it to crash. 27B did not have that issue for me but it's much slower. Here's how I got the 35B model to work: https://gist.github.com/danthedaniel/c1542c65469fb1caafabe1371e8ed445 https://gist.github.com/danthedaniel/c1542c65469fb1caafabe13... The 35B model is still pretty slow on my machine but it's cool to see it working.

badgersnake 7mo ago

I’ve tried it on Claude code, Found it to be fairly crap. It got stuck in a loop doing the wrong thing and would not be talked out of it. I’ve found this bug that would stop it compiling right after compiling it, that sort of thing. Also seemed to ignore fairly simple instructions in CLAUDE.md about building and running tests.

tommyjepsen 7mo ago

I ran the Qwen3 Coder 30B through LM Studio and with OpenCode(Instead of Claude code). Did decent on M4 Max 32GB. https://www.tommyjepsen.com/blog/run-llm-locally-for-coding https://www.tommyjepsen.com/blog/run-llm-locally-for-coding

andsoitis 7mo ago

I use Claude Code for agentic coding but it is better to use qwen3-coder in that case. It qwen3-coder is better for code generation and editing, strong at multi-file agentic tasks, and is purpose-built for coding workflows. In contrast, qwen3.5 is more capable at general reasoning, better at planning and architecture decisions, good balance of coding and thinking.

Aurornis 7mo ago

The 9B models are not useful for coding outside of very simple requests. Qwen3.5 is confusing a lot of newcomers because it is very confident in the answers it gives. It can also regurgitate solutions to common test requests like “make a flappy bird clone” which misleads users into thinking it’s genetically smart. Using the Qwen3.5 models for longer tasks and inspecting the output is a little more disappointing. They’re cool for something I can run locally but I don’t agree with all of the claims about being Sonnet-level quality (including previous Sonnet versions) in my experience with the larger models. The 9B model is not going to be close to Sonnet in any way.