2 ms·

What kinda volume are you pushing though because I also do that and even have it ingest whole pdfs/word docs as conversation context and I get charged like $3/m

by Spivak 4y ago

What kinda volume are you pushing though because I also do that and even have it ingest whole pdfs/word docs as conversation context and I get charged like $3/mo on average. Edit: I’m literally agreeing with you and describing innocuous questions that it doesn’t respond to. I’m saying that if all it refused to do was write hate and erotica it would be fine and I would use it but the filter catches things like code.

superkuh 4y ago
With gpt3 davinci we were doing about ~30 requests for text completion per hour (at peak activity) each having ~11 lines of chat history (including up to 190 token responses from davinci) which added up to about ~1000 to 5000 tokens each. So 30*3000 at $0.0200/1000 tokens equals a few dollars per day.