3 ms·
I'm taking a bet on local models to do the non genius work. Gemma 4 (released yesterday) has been designed to run on laptops / edge devices....and so far is run
by Flere-Imsaho 7mo ago
I'm taking a bet on local models to do the non genius work. Gemma 4 (released yesterday) has been designed to run on laptops / edge devices....and so far is running pretty well for me.
- neal_jones 7mo agoHow’s Gemma 4 been?
- renewiltord 7mo agoEdge models are good for their purpose but putting them in agentic flow with current ollama quants on a Mac Mini I see high tool use error rate and output hallucination. For JSON to text formatting it works well on a one-round basis. So I think you should realistically have an evaluation ready to go so you can use it on these models. I currently judge them myself but people often use a smart LLM as judge. Today writing eval harness with Claude is 5 min job. Do it yourself so you can explore as quants on Gemma get better.