2 ms·
That's true as long as it's free. API users will still want to optimize for cost.
by skybrian 3y ago
That's true as long as it's free. API users will still want to optimize for cost.
- infecto 3y agoProbably for a lot of uses but there are plenty who optimize for value and the cost does not matter. Unanswered question since 32k does not exist in the API. Does a longer context improve summarization? Can we use it for chain of thought or other workflows that can benefit with a longer context?