3 ms·
Yes, but at the same time having the 1 million context enabled is nice because the model is aware that they have more context left and actually perform better.
by navanchauhan 1y ago
Yes, but at the same time having the 1 million context enabled is nice because the model is aware that they have more context left and actually perform better. [0]
[0] https://cognition.ai/blog/devin-sonnet-4-5-lessons-and-challenges#:~:text=When%20researching%20ways%20to%20address%20this%20issue%2C%20we%20discovered%20one%20unexpected%20trick%20that%20worked%20well:%20enabling%20the%201M%20token%20beta%20but%20cap%20usage%20at%20200k.%20 https://cognition.ai/blog/devin-sonnet-4-5-lessons-and-chall...