2 ms·
With gpt3 davinci we were doing about ~30 requests for text completion per hour (at peak activity) each having ~11 lines of chat history (including up to 190 to
by superkuh 4y ago
With gpt3 davinci we were doing about ~30 requests for text completion per hour (at peak activity) each having ~11 lines of chat history (including up to 190 token responses from davinci) which added up to about ~1000 to 5000 tokens each. So 30*3000 at $0.0200/1000 tokens equals a few dollars per day.