2 ms·
Those market forces will push the thriftier devs to find better ways to use the lesser models. And they will probably share their improvements! I'm very bullis
by mring33621 1y ago
Those market forces will push the thriftier devs to find better ways to use the lesser models. And they will probably share their improvements!
I'm very bullish on the future of smaller, locally-run models, myself.
- cmrdporcupine 1y agoI have not invested time on locally-run, I'm curious if they could even get close to approaching the value of Sonnet4 or Opus. That said, I suspect a lot of the value in Claude Code is hand-rolled fined-tuned heuristics built into the tool itself, not coming from the LLM. It does a lot of management of TODO lists, backtracking through failed paths, etc which look more like old-school symbolic AI than something the LLM is doing on its own. Replicating that will also be required.