3 ms·
Probably for a lot of uses but there are plenty who optimize for value and the cost does not matter. Unanswered question since 32k does not exist in the API. Do
by infecto 3y ago
Probably for a lot of uses but there are plenty who optimize for value and the cost does not matter. Unanswered question since 32k does not exist in the API. Does a longer context improve summarization? Can we use it for chain of thought or other workflows that can benefit with a longer context?