3 ms·
> [others] Output tokens: ~5x more expensive than input tokens. > [them] Output tokens: FREE (too cheap to meter). I'm very confused by this.
by initsecret 19d ago
> [others] Output tokens: ~5x more expensive than input tokens.
> [them] Output tokens: FREE (too cheap to meter).
I'm very confused by this.
- varenc 19d agoThe output tokens are just responses to your inputed questions and their probability. So relatively few output tokens. No unstructured text back in the response.
- quotemstr 19d agoThey're not doing autoregression, so all the outputs are computed in one big forward pass. Very cheap.
- ambicapter 19d agoI think OP is confused about "others" vs "them".
- initsecret 19d agothey’re talking about two totally different things, right?
- CompleteSkeptic 19d agoit's our output tokens that are free (under the system one / jev column)
- someguynamedq 19d agoThis is not confusing