3 ms·
From what I understand this seems useful if you have a model that will accept a large or unlimited number of tokens. I was looking into doing the same thing wit
by bebrws 4y ago
From what I understand this seems useful if you have a model that will accept a large or unlimited number of tokens. I was looking into doing the same thing with ChatGPT and went with ada to find snippets related to the prompt and then to include those with a prompt to ChatGPT: https://bbarrows.com/posts/using-embeddings-ada-and-chatgpt-to-search-and-query-a-new-codebase https://bbarrows.com/posts/using-embeddings-ada-and-chatgpt-...
Does ChatGPT 4 now accept more tokens maybe?
- jerpint 4y agoChatGPT 4 currently accepts 8000 tokens and will eventually support 32k
- inciampati 4y agoI can't get it to eat 8k tokens. I assume this is only available via the api. The web interface is limited to around 2k tokens.
- sp332 4y agoThe help page says you have to select the 8k model to do 8k. If there's no UI for that, then I guess it's API-only. And the 32k one is being rolled out separately. I think you have to sign up for access to that one.