You're probably aware, but OpenAI has different speeds for different kinds of customers. The most prioritized ones are accounts that have gpt-4-32k. An easy to

You're probably aware, but OpenAI has different speeds for different kinds of customers. The most prioritized ones are accounts that have gpt-4-32k. An easy to see this difference is comparing a trial account's Turbo speed to a pay-as-you-go one. With an account with gpt-4-32k I observed around 125 tokens/s for gpt-3.5-turbo-16k maximum (4k turbo was slower by the way), as for normal gpt-4 on the same account - I don't remember exactly, but it was at least 20 tokens/sec. In short, you can clearly observe the difference in speed (even for Turbo) like this: trial account < paid < paid with gpt-4 access < gpt-4-32k-enabled account