3 ms·
That input is 610 tokens. With the actual prompt and the response let's say you hit 1000 tokens. That would be 2 cents per question then. Not sure how often do
by eknkc 4y ago
That input is 610 tokens. With the actual prompt and the response let's say you hit 1000 tokens. That would be 2 cents per question then.
Not sure how often do people ask Siri questions but that seems like it would not be a significant cost for one user. If you were to build a service on top of it, that might be expensive though.
- PebblesRox 4y agoIn a home with only responsible adults, it would be fine. With kids it would be a repeat of the olden days before unlimited texting when the parents would get the cellphone bill at the end of the month. But I wonder how soon we’ll have fine-tuned or otherwise customized specialized LLMs that are cheaper to run? In the mean time this kind of thing is a really neat proof-of-concept of how ChatGPT’s abilities can be harnessed.