3 ms·
How does the 270 perform with coding? I use Gemma27b currently with a custom agent wrapper and its working pretty well.
by ActorNightly 1y ago
How does the 270 perform with coding?
I use Gemma27b currently with a custom agent wrapper and its working pretty well.
- chrismustcode 1y agoI’d be stunned if a 270m model could code with any proficiency. If you have an iPhone with the semi-annoying autocomplete that’s a 34m transformer. Can’t imagine a model (even if it’s a good team behind it) to do coding with 8x the parameters of a next 3/4 word autocomplete.
- 0x457 1y agoSomeone should try this on that model: https://www.oxen.ai/blog/training-a-rust-1-5b-coder-lm-with-reinforcement-learning-grpo https://www.oxen.ai/blog/training-a-rust-1-5b-coder-lm-with-...
- all2 1y agoCan you talk about your agent wrapper setup? What tools, if any did you use? How effective is it at making a dumb model smart?