4 ms·

Pi by itself is more than capable, OMP is okay but you really don't need much for a great harness (these models are RL trained to hell to be a coding agent, som

Pi by itself is more than capable, OMP is okay but you really don't need much for a great harness (these models are RL trained to hell to be a coding agent, sometimes less is more) I run a lot of SlopCodeBench - https://github.com/michaelasper/benchmarks https://github.com/michaelasper/benchmarks Fable/Sol/GLM 5.3/Kimi are its league (in that order) Deepseek/Opus is solid Qwen 27B is the floor - there's no reason to use Sonnet/Terra/Haiku For everyday activity - I don't think you need to be using Sol (xhigh) for everything - unless you're made of money - I've found using Luna from OpenAI to be more than enough - it'll outreach to Opus/Sol when it needs to Haven't had access to Gemini 3.7 but we're getting it at work soon, will give it a go! Codex CLI is pretty bare bones in a bad way (at least Pi is extensible). Claude code is vibeslopped to the extreme

vardalab 1mo ago
Using Sol XHigh or even High will deplete the Pro sub pretty fast in my experience if one is running any sort of automations in their harnesses. Sol-medium lets me squeek by with it using lesser subagents. Using ninfer on 5090 and 35BA3B qwen 3.6 is also kind of cool to get a local cerebras experience at 600 tk/, it does make errors so 27B is actually faster at the end at 140-150 tk/s. 35B is great though at digging through session logs and such at high speed.
- Makson179 1mo ago
  Effort level might not be the root of the problem. In my runs reasoning is around 10% of the cost and writing code maybe 20%. The rest is 5.6 re-reading files. Model itself became way too meticulous.
andai 1mo ago
> you really don't need much for a great harness (these models are RL trained to hell to be a coding agent, sometimes less is more) To be precise, you need a while-loop, user input and bash. It's about 50 lines of Python: https://minimal-agent.com/ https://minimal-agent.com/ I built my own agent based on this and use it every day.
ValentineC 1mo ago
I'm sad that Opus is now considered "solid" and not on par with Sol, since OpenAI supposedly has "Astra" which I thought would be comparable to Fable. It was "amazing" back when I first tried 4.6, but that's just my rose-coloured glasses speaking, I guess. I think I was one of the first few to call out Opus 5 for being hot garbage.
freepiai 1mo ago
Even if you're made of money Sol(xhigh) is too slow to be a daily driver. I've largely moved over to using my own harness (yes I'm trying to gtm it by sharing: www.freepi.ai- free inference! in pi! batteries included!) and my main model there is deepseek v4 flash (and I've got a fast provider!) But seriously: Fable still makes the best/smartest plans. That new Ox Alpha (also in Freepi right now!) can do a very good job but it doesn't necessarily recheck it's own reasoning (and can get stuck in an incorrect assumption and try to fit the world around it's reasoning) Sol xhigh is also very smart but god it's slow, and it frequently massively overbuilds. It's like it's main goal is to spend tokens so it makes your react app Soc 2 compliant before it proves it even works. I've largely stopped using the Gemini models. :-/ just hard to justify. Basically the only thing I care about these days is SPEED.

vardalab 1mo ago

Using Sol XHigh or even High will deplete the Pro sub pretty fast in my experience if one is running any sort of automations in their harnesses. Sol-medium lets me squeek by with it using lesser subagents. Using ninfer on 5090 and 35BA3B qwen 3.6 is also kind of cool to get a local cerebras experience at 600 tk/, it does make errors so 27B is actually faster at the end at 140-150 tk/s. 35B is great though at digging through session logs and such at high speed.

Makson179 1mo ago
Effort level might not be the root of the problem. In my runs reasoning is around 10% of the cost and writing code maybe 20%. The rest is 5.6 re-reading files. Model itself became way too meticulous.

andai 1mo ago

> you really don't need much for a great harness (these models are RL trained to hell to be a coding agent, sometimes less is more) To be precise, you need a while-loop, user input and bash. It's about 50 lines of Python: https://minimal-agent.com/ https://minimal-agent.com/ I built my own agent based on this and use it every day.

ValentineC 1mo ago

I'm sad that Opus is now considered "solid" and not on par with Sol, since OpenAI supposedly has "Astra" which I thought would be comparable to Fable. It was "amazing" back when I first tried 4.6, but that's just my rose-coloured glasses speaking, I guess. I think I was one of the first few to call out Opus 5 for being hot garbage.

freepiai 1mo ago

Even if you're made of money Sol(xhigh) is too slow to be a daily driver. I've largely moved over to using my own harness (yes I'm trying to gtm it by sharing: www.freepi.ai- free inference! in pi! batteries included!) and my main model there is deepseek v4 flash (and I've got a fast provider!) But seriously: Fable still makes the best/smartest plans. That new Ox Alpha (also in Freepi right now!) can do a very good job but it doesn't necessarily recheck it's own reasoning (and can get stuck in an incorrect assumption and try to fit the world around it's reasoning) Sol xhigh is also very smart but god it's slow, and it frequently massively overbuilds. It's like it's main goal is to spend tokens so it makes your react app Soc 2 compliant before it proves it even works. I've largely stopped using the Gemini models. :-/ just hard to justify. Basically the only thing I care about these days is SPEED.