4 ms·

I can't find back the exact post, but on r/LocalLlaMA, some people ended up debugging that. Instead of prompting <thinking>, prompt <thinking>\n, and then they

by phh 2y ago

I can't find back the exact post, but on r/LocalLlaMA, some people ended up debugging that. Instead of prompting <thinking>, prompt <thinking>\n, and then they got the same kind of response as the API.