2 ms·
I'd love to know how much a 1 million token prompt is likely to cost - both in terms of cash and in terms of raw energy usage.
by simonw 3y ago
I'd love to know how much a 1 million token prompt is likely to cost - both in terms of cash and in terms of raw energy usage.
- bearjaws 3y agoCannot emphasize enough, even with the improvements in context handling I imagine 128k tokens costs as much as 16k tokens did previously. So 1M tokens is going to be astronomical.
- empath-nirvana 3y agoWhen you account for this, you have to consider how much it would cost to have a human perform the same task.