That is the model I've been playing with for my homebrew assistant, as mentioned here[1]. The medium and lower models wasn't quite up to the task, miss-interpr

That is the model I've been playing with for my homebrew assistant, as mentioned here[1]. The medium and lower models wasn't quite up to the task, miss-interpreting some crucial words here and there, but so far I've been very pleased with the large Q5 model. It directly translates into English well enough that subsequent English LLMs understand the meaning with high degree of accuracy, at about 5-10x real-time on my 2080 Ti. [1]: https://news.ycombinator.com/item?id=41396649 https://news.ycombinator.com/item?id=41396649