4 ms·
Are your requests above 1400 tokens in size? Requests, not replies. Small requests (like what most people need) are just fine. It's the larger ones that being
by jwr 3y ago
Are your requests above 1400 tokens in size? Requests, not replies.
Small requests (like what most people need) are just fine. It's the larger ones that being to slow down quickly and then break down completely as one gets above 1400 tokens.