4 ms·
The quantized version is very bad, when I promoted it something, it misspelled some of the prompt when it tried to say it back to me and gets some simple coding
by m3kw9 2y ago
The quantized version is very bad, when I promoted it something, it misspelled some of the prompt when it tried to say it back to me and gets some simple coding questions completely wrong. Like I ask it to specifically program in one language, it gives me another, and when I got it to do it, the code is completely wrong. The thinking out loud part wastes a lot of tokens