2 ms·
For one, you don't get to see any output at all if you run out of tokens during thinking. If you set a limit, once it's hit you just get a failed request with
by BoorishBears 2y ago
For one, you don't get to see any output at all if you run out of tokens during thinking.
If you set a limit, once it's hit you just get a failed request with no introspection on where and why CoT went off the rails
- Aeolun 2y agoWhy would I pay for zero output? That’s essentially throwing money down the drain.
- deleted 2y ago[deleted]