3 ms·
That's quite expensive indeed. At full context of 200K, that would be at least $3 per use. I would hate it if I receive a refusal as answer at that rate.
by mrtksn 3y ago
That's quite expensive indeed. At full context of 200K, that would be at least $3 per use. I would hate it if I receive a refusal as answer at that rate.
- jorgemf 3y agocost is relative. how much would it cost for a human to read and give you an answer for 200k tokens? Probably much more than $3.
- vinay_ys 3y agoYou are not going to take the expensive human out of the loop where downside risk is high. You are likely to take the human out of the loop only in low risk low cost operations to begin with. For those use cases, these models are quite expensive.
- jakderrida 3y agoYeah, but the human tends not to get morally indignant because my question involves killing a process to save resources.