3 ms·
My approach to this problem is to just...not try them all. As long as the model you're using solves the problems you have to your satisfaction, there is no nee
by Systemerror7A69 15d ago
My approach to this problem is to just...not try them all.
As long as the model you're using solves the problems you have to your satisfaction, there is no need to try any other models, except for financial reasons maybe.
So I start with a relatively cheap model (GLM 5.3 flash for me) and as long as it accomplishes the task (it did so far) I don't have to change. And even if it can't do something, the first thing I change is see if I can give it more tools or better context (useful even if I switch models later) or trying a different approach to the problem.
If google/gemma-4-31b works, you don't need to overthink it.
- bmordue 15d agosatisficing instead of optimising
- blensor 15d agoThis 100%
- deleted 15d ago[deleted]
- insightfulornot 15d agoStarting with GLM-5.3 Flash was a pretty decent first try! I started with other models, and ended up settling on this exact one because all the others were either too slow or unreliable for my tasks. Qwen 3.8 didn't do it for me, whatever tweaks I added to my harness. Where I'm getting at is you did start with an incredible model in the first place, which greatly helps sticking to it.
- alfiedotwtf 14d agoGLM-5.3 Flash has been my goto since it came out. Only failed once when it lost context, but I'm assuming that was my fault rather than the model. If models never make it past today's close-to-frontier for the rest of my life, I wouldn't complain.
- epolanski 15d ago> If google/gemma-4-31b works, you don't need to overthink it. Up until recently I had a gemini flash 2.0 api deployed that did summarization and translation of news articles/corporate statements fast and cheap and had no reason to update it. If it works fine, this chase of the latest LLM is bit pointless.
- Lalabadie 15d agoOpenAI, Anthropic and peers deeply fear that everyone would eventually come to that same conclusion. (I think you're right)
- verst 15d agoI find Qwen 3.8 better at coding but I also use Gemma 4 31B. I toggle between them in Ollama.
- cogman10 15d agoYeah, I really think we are on the cusp on the difference between SOTA and cheap models is small enough that paying 10x or 100x the cost makes no sense. It also helps that a lot of effort has already been spent figuring out how to do more with weaker models because SOTA 1 year ago was behind what the cheap models do today. 1 year from now, unless the SOTA companies come up with something truly revolutionary they will be in a lot of trouble.
- t_mahmood 15d agoWhich is why they are just making sure we can't buy any GPU to use any models. And because GPUs are so costly, I would be just worried to ruin it running a model continuously. Yeah, might be far fetched, but it seems like heading that way
- barrenko 15d agoI use Gemini(s) because I can send pdfs as files to their API and not worry too much. I've started to diverge and consacrate a part of my pipeline to sending image based pdf pages to glm flash 5.3, not sure how to address / test it properly. Long term I have fears I can't depend of the Google's AI api.