I tried gemma2 but it has to be quantified to hell to fit in a 16gb card and then it performs a lot worse than llama3 8b unforutnately. I hope the new mistral

I tried gemma2 but it has to be quantified to hell to fit in a 16gb card and then it performs a lot worse than llama3 8b unforutnately. I hope the new mistral comes out soon for ollama. True about the context window but with llama3 this was not a problem as it has such a small context window anyway.