2 ms·
What are you doing that cannot benefit from a larger context window? Just having a long conversation with chatgpt can benefit from this.
by infecto 3y ago
What are you doing that cannot benefit from a larger context window? Just having a long conversation with chatgpt can benefit from this.
- skybrian 3y agoThat's true as long as it's free. API users will still want to optimize for cost.
- infecto 3y agoProbably for a lot of uses but there are plenty who optimize for value and the cost does not matter. Unanswered question since 32k does not exist in the API. Does a longer context improve summarization? Can we use it for chain of thought or other workflows that can benefit with a longer context?