3 ms·
It's a great idea, but I'm really concerned about the use of OpenAI in this Have you tried implementing the same functionality using open-source models?
by ushakov 4y ago
It's a great idea, but I'm really concerned about the use of OpenAI in this
Have you tried implementing the same functionality using open-source models?
- kiwicopple 4y agowe haven't but we certainly will in future iterations
- Raed667 4y agoI'm curious what is the estimated cost for running this?
- kiwicopple 4y agoit looks like we're getting 1800 requests per hour - about $5/hour, which is pretty cheap considering the traffic seeing this blog post. That said, only desktop users who have access to the keyboard and have read the blog post can use it. If we made it visible to everyone I think we would quickly run into API limits.
- wonderfuly 4y ago$5 for 1800 requests, that is 0.0027 per request, text-davinci-003 price is $0.02/1k token, so the average token number is 135. That is far below my expectation.