4 ms·
Been using it exclusively since December, 5bit quantized, 8,000 token context window Sometimes you need a model that just gives you the feeling “that’ll do” I
by yieldcrv 3y ago
Been using it exclusively since December, 5bit quantized, 8,000 token context window
Sometimes you need a model that just gives you the feeling “that’ll do”
I did switch to Miqu a few weeks back though. 4 bit quantized