2 ms·
The biggest issue when you have local LLMs is that people “use” them in different way which can cause different impression. As a somewhat PSA, try loading the Q
by syntaxing 2y ago
The biggest issue when you have local LLMs is that people “use” them in different way which can cause different impression. As a somewhat PSA, try loading the Q6 KM if possible. Q5 KM at a minimum. Anything lower like the default of ollama Q4_0 will have noticeable quality degradation.