4 ms·
This 100% tracks with my experience. Also fun stuff many don't know - If you run a regular models chat template with a reasoning tuned model, it can go back to
by Der_Einzige 2y ago
This 100% tracks with my experience.
Also fun stuff many don't know - If you run a regular models chat template with a reasoning tuned model, it can go back to acting like the base model, with no "thinking" process.
"Reasoning" models are not any better than non reasoning models. It's a parlor trick, and benchmarks which claimed it wasn't are bad.
- NitpickLawyer 2y ago> If you run a regular models chat template with a reasoning tuned model, it can go back to acting like the base model, with no "thinking" process. Well, of course. They've been "fine-tuned" with specific chat templates. Remove those and the fine-tune doesn't take precedence anymore. That's expected behaviour I'd say. > "Reasoning" models are not any better than non reasoning models. It's a parlor trick, and benchmarks which claimed it wasn't are bad. All of them? Including the closed ones, never public? I highly doubt that.