4 ms·

Considering the full fat Qwen3.5-plus is good, but barely Sonnet 4 good in my testing (but incredibly cheap!) I doubt the quantised versions are somehow as good

by girvo 8mo ago

Considering the full fat Qwen3.5-plus is good, but barely Sonnet 4 good in my testing (but incredibly cheap!) I doubt the quantised versions are somehow as good if not better in practice.

stavros 8mo ago
When you say Sonnet 4, do you mean literally 4, or 4.6?
- girvo 8mo ago
  It's not as capable as Sonnet 4.6 in my usage over the past couple days, through a few different coding harnesses (including my own for-play one[0], that's been quite fun). [0] https://github.com/girvo/girvent/ https://github.com/girvo/girvent/
  - dr_kiszonka 8mo ago
    What is the benefit of writing your own harness? I am asking because I need to get better at using AI for programming. I have used Cursor, Gemini CLI, Antigravity quite a bit and have had a lot of difficulties getting them do what I want. They just tend to "know better."
    - newswasboring 8mo ago
      I think it's the same instinct as making your own Game Engine. You start off either because you want to learn how they work or because you think your game is special and needs its own engine. Usually, it's a combination of both.
    - everforward 8mo ago
      I’m not an expert but I started with smaller tasks to get a feel for how to phrase things, what I need to include. It’s more manageable to manually fix things it screwed up than giving it full reign. You may want to look at the AGENTS.md file too so you can include your stock style things if it’s repeatedly screwing up in the same way.
    - girvo 8mo ago
      Purely as an exercise to see how they operate, and understand them better. Then additionally because I was curious how much better one could make something like qwen3.5-plus with its 1 mil context window despite its weaker base behaviour, if I was to give it something very focused on what I want from it The Pi framework is probably right up your alley btw! Very extensible
rustyhancock 8mo ago
I think it depends on work pattern. Many do not give Sonnet or even Opus full reign where it really pushes ahead of over models. If you're asking for tightly constrained single functions at a time it really doesn't make a huge difference. I.e. the more vibe you do the better you need the model especially over long running and large contexts. Claude is heading and shoulders above everyone else in that setting.
- girvo 8mo ago
  >I.e. the more vibe you do the better you need the model especially over long running and large contexts For sure, but the coolest thing about qwen3.5-plus is the 1mil context length on a $3 coding plan, super neat. But the model isn't really powerful enough to take real advantage of it I've found. Still super neat though!

by girvo 8mo ago

Considering the full fat Qwen3.5-plus is good, but barely Sonnet 4 good in my testing (but incredibly cheap!) I doubt the quantised versions are somehow as good if not better in practice.

stavros 8mo ago

When you say Sonnet 4, do you mean literally 4, or 4.6?

girvo 8mo ago
It's not as capable as Sonnet 4.6 in my usage over the past couple days, through a few different coding harnesses (including my own for-play one[0], that's been quite fun). [0] https://github.com/girvo/girvent/ https://github.com/girvo/girvent/
- dr_kiszonka 8mo ago
  What is the benefit of writing your own harness? I am asking because I need to get better at using AI for programming. I have used Cursor, Gemini CLI, Antigravity quite a bit and have had a lot of difficulties getting them do what I want. They just tend to "know better."
  - newswasboring 8mo ago
    I think it's the same instinct as making your own Game Engine. You start off either because you want to learn how they work or because you think your game is special and needs its own engine. Usually, it's a combination of both.
  - everforward 8mo ago
    I’m not an expert but I started with smaller tasks to get a feel for how to phrase things, what I need to include. It’s more manageable to manually fix things it screwed up than giving it full reign. You may want to look at the AGENTS.md file too so you can include your stock style things if it’s repeatedly screwing up in the same way.
  - girvo 8mo ago
    Purely as an exercise to see how they operate, and understand them better. Then additionally because I was curious how much better one could make something like qwen3.5-plus with its 1 mil context window despite its weaker base behaviour, if I was to give it something very focused on what I want from it The Pi framework is probably right up your alley btw! Very extensible

rustyhancock 8mo ago

I think it depends on work pattern. Many do not give Sonnet or even Opus full reign where it really pushes ahead of over models. If you're asking for tightly constrained single functions at a time it really doesn't make a huge difference. I.e. the more vibe you do the better you need the model especially over long running and large contexts. Claude is heading and shoulders above everyone else in that setting.

girvo 8mo ago
>I.e. the more vibe you do the better you need the model especially over long running and large contexts For sure, but the coolest thing about qwen3.5-plus is the 1mil context length on a $3 coding plan, super neat. But the model isn't really powerful enough to take real advantage of it I've found. Still super neat though!