3 ms·
I just want to know if my next prompt is about to eat shit at the last token. The number of times it like half works on something and falls apart halfway throug
by giancarlostoro 5mo ago
I just want to know if my next prompt is about to eat shit at the last token. The number of times it like half works on something and falls apart halfway through.
- xienze 5mo agoYou likely still wouldn't be able to figure that out even if you had a percent usage view available. Will your request take 1K tokens or 10K? Who knows! That's the magic of non-deterministic black boxes.