3 ms·
Yes, but the r1 model is shiny and new. I've been using it locally for a day and I'm already finding odd spots. One thing that I've seen it do a number of times
by llm_trw 2y ago
Yes, but the r1 model is shiny and new. I've been using it locally for a day and I'm already finding odd spots. One thing that I've seen it do a number of times is get the correct answer in the thinking tokens, then ignore it, generate thousands more tokens until it reaches it context length then give a wrong answer.
There are things, like doc strings for functions, that llama models give better results for.