3 ms·
I'm thinking the next step would be to include this as a 'junior dev' and let Opus farm simple stuff out to it. It could be local, but also if it's on cerebras,
by vessenes 9mo ago
I'm thinking the next step would be to include this as a 'junior dev' and let Opus farm simple stuff out to it. It could be local, but also if it's on cerebras, it could be realllly fast.
- ttoinou 9mo agoCerebras already has GLM 4.7 in the code plans
- vessenes 9mo agoYep. But this is like 10x faster; 3B active parameters.
- ttoinou 9mo agoCerebras is already 200-800 tps, do you need even faster ?
- overfeed 9mo agoYes! I don't try to read agent tokens as they are generated, so if code generation decreases from 1 minute to 6 seconds, I'll be delighted. I'll even accept 10s -> 1s speedups. Considering how often I've seen agents spin wheels with different approaches, faster is always better, until models can 1-shot solutions without the repeated "No, wait..." / "Actually..." thinking loops
- pqtyw 9mo ago> until models can 1-shot solutions without the repeated "No, wait..." / "Actually..." thinking loops That would imply they'd have to be actually smarter than humans, not just faster and be able to scale infinitely. IMHO that's still very far away..