3 ms·
It’s not just the quantity of tokens in context that matters, but the coherence of the concepts in the context. Many conflicting ideas are harder for models to
by Yusefmosiah 2y ago
It’s not just the quantity of tokens in context that matters, but the coherence of the concepts in the context.
Many conflicting ideas are harder for models to follow than one large unified idea.