4 ms·
Are you paying for the API calls yourself here?
by iknownthing 2y ago
Are you paying for the API calls yourself here?
- Falimonda 2y agoIt seems like they're caching information/replies on key words which is a good optimization.
- iknownthing 2y agoI assumed it was coming straight from the API because of the token-by-token generation effect but maybe you're right.
- rodiger 2y agoThe token-by-token responses are probably API, while the "instant" loads seem to be cached. Probably using groq based on speed of response
- maxkrieger 2y agoI have a lot of OpenAI API credits to use by end of the month, so I’m using 4o. I’ll probably switch to a more sustainable model afterwards, consider this a request for API credits, all! Email’s on website :)