3 ms·
I suspect 1M token context is questionable value because of the secondary effect of burning quota vs getting work done. I think the model select that let me ch
by sunir 6mo ago
I suspect 1M token context is questionable value because of the secondary effect of burning quota vs getting work done.
I think the model select that let me choose 1M made sense because I could decide if I was working on large documents and compacting more often was more effective.