8 ms·
... because they are often the first to quant it. sometimes the actually model providers will release wrong chat templates or values in the model config which
by segmondy 2mo ago
... because they are often the first to quant it. sometimes the actually model providers will release wrong chat templates or values in the model config which leads to bad quants. how would you know a quant is good if you don't make one? you don't. so they make it first, then they run a lot of tests, KD, perplexity, etc, they publish it. They take feedback from the community, then they update if needed. if you want to try it right now, you grab it else wait for a week or 2.
- Foobar8568 2mo agoGemma4 was released a few weeks ago? The problems are still there. Today I started using another "provider" and the problems disappeared. Thanks but no.
- arcanemachiner 2mo agoThey are very responsive, and would probably be happy to help you fix your issues.
- danielhanchen 2mo agoHey yes - if you could describe what the issues are - we will gladly fix them!
- Foobar8568 2mo agoMea-culpa, dry-multiplier generated crap and even more so on Gemma4.
- danielhanchen 2mo agoOk no worries - if there are any future issues - feel free to message / make a HF issue - we'll fix promptly! Also note its best to follow Gemma4's official sampling params since they evaled with it - dry multiplier sometimes works, but it actually screws up reasoning sometimes
- segmondy 2mo agoI've 0 issues with gemma4 and I downloaded it early.
- LeBit 2mo agoSame. Used the 12B, 26B A4B and 31B. No issues with llama.cpp.