2 ms·
I’m really struggling to find any actual numbers so I could be very wrong but I vaguely remember input tokens being around 10x faster Basing it on pricing does
by circuit10 4y ago
I’m really struggling to find any actual numbers so I could be very wrong but I vaguely remember input tokens being around 10x faster
Basing it on pricing doesn’t seem like a good way to estimate it because it varies so much but:
- OpenAI charges the same for input and output tokens, except for GPT4 where output tokens cost twice as much as inputs
- textsynth.org charges 25 times as much for outputs than for inputs
- goose.ai doesn’t charge for inputs
Also you have limited context length so that limits how much data you can read