3 ms·
It costs something like 0.03-0.06 cents per thousand tokens. So for 32k that's about $1-3 for reading and another $1-3 for the response. So sure, still cheap f
by geysersam 4y ago
It costs something like 0.03-0.06 cents per thousand tokens. So for 32k that's about $1-3 for reading and another $1-3 for the response.
So sure, still cheap for a doctor appointment, but not pennies. Do it 30 times per hour and you could've just hired a consultant instead.
Does it reason as well with 32k tokens as with 1k tokens? Like you said, humans find it difficult to really comprehend large amounts of content. Who says this machine isn't similarly limited? Just because you can feed it the 32k simultaneously doesn't mean it will actually be used effectively.
- Semioj 4y agoYou still could not. Chatgpt could in theory have the knowledge of everything written while your consultant can't.
- geysersam 4y agoSure... But in practice I think a consultant would still provide a higher quality answer. And then, if the bot is not significantly cheaper, what does it matter if it "has more knowledge" in it's network weights?
- ericpauley 4y agoFurther, a consultant couldn’t meaningfully interpret 50 pages in 2 minutes, even with the most cursory skimming.
- hackernewds 4y agoAn LLM can never offset a consultants diverse duties though. Some, maybe. However you cannot run healthcare with 90% specificity
- zachthewf 4y agoCost of ChatGPT API just dropped 90%. Guaranteed that prices will come down dramatically over time.
- tzekid 4y agoI don't get why this comment is downvoted. Basically this. A halving of the costs every year or so seems realistic in this emerging phase.
- hackernewds 4y agoYet in a capitalist society, against business interests. Look at how Snowflake (the data warehousing company) is driven now, vs before they were public
- stbede 4y agoIn a capitalist economy with several major AI competitors, two of which already offers search for free.