2 ms·
How did you chose the 8192 token thinking budget? I've often seen Deepseek R1 use way more than that.
by guelo 2y ago
How did you chose the 8192 token thinking budget? I've often seen Deepseek R1 use way more than that.
- freediver 2y agoArbitrary, and even with this budget it is already more verbose (and slower) overall than all the other thinking models - check tokens and latency in the table.