3 ms·
Perhaps model size and reasoning length trade off to some extent, similar to CPU vs. RAM. A smaller model with a longer reasoning trace has more intermediate st
by _tgxm 2mo ago
Perhaps model size and reasoning length trade off to some extent, similar to CPU vs. RAM. A smaller model with a longer reasoning trace has more intermediate structure to latch onto and build on.
- deflator 2mo agoMakes sense to me. We will see, since if true then it is likely the other makers of small, dense models will copy it and include high reasoning by default. If that also makes the other dense open source models better, then you are probably correct.