3 ms·
This is why with future models and their effectively unlimited context size you'll simply concatenate the entire API codebase you're using into the context of y
by Der_Einzige 3y ago
This is why with future models and their effectively unlimited context size you'll simply concatenate the entire API codebase you're using into the context of your prompt.
- influx 3y agoI've done similar already, but ChatGPT still tends to rewrite the code to the old API, even if it's correctly using the new API. Ironically, I just had this happen to me while using ChatGPT 4 to use the OpenAI API.
- vitorsr 3y agoAs far as I can tell, pricing per token is not going away anytime soon.
- joshspankit 3y agoAt 100k and above price will naturally come down to be equivalent
- blharr 3y agoAlthough the attention is really good at focusing on specific information, I've had problems with this approach. It seems like if I ask a task and provide a large enough API it gets distracted or ignores the chunk of text and does its own thing anyway. Also it's still more expensive to increase the context length