5 ms·
You likely still wouldn't be able to figure that out even if you had a percent usage view available. Will your request take 1K tokens or 10K? Who knows! That's
by xienze 4mo ago
You likely still wouldn't be able to figure that out even if you had a percent usage view available. Will your request take 1K tokens or 10K? Who knows! That's the magic of non-deterministic black boxes.