3 ms·
I can't get it to eat 8k tokens. I assume this is only available via the api. The web interface is limited to around 2k tokens.
by inciampati 4y ago
I can't get it to eat 8k tokens. I assume this is only available via the api. The web interface is limited to around 2k tokens.
- sp332 4y agoThe help page says you have to select the 8k model to do 8k. If there's no UI for that, then I guess it's API-only. And the 32k one is being rolled out separately. I think you have to sign up for access to that one.