4 ms·
You have to specify `/model sonnet[1m]` to get the 1 million context version
by navanchauhan 1y ago
You have to specify `/model sonnet[1m]` to get the 1 million context version
- AutumnsGarden 1y agoThank you!! I've been looking for this for a while now.
- brulard 1y agoBe careful. exceeding around the original 200k tokens leads to worse and worse results. It's important to have context clean and tailored to the current task.
- navanchauhan 1y agoYes, but at the same time having the 1 million context enabled is nice because the model is aware that they have more context left and actually perform better. [0] [0] https://cognition.ai/blog/devin-sonnet-4-5-lessons-and-challenges#:~:text=When%20researching%20ways%20to%20address%20this%20issue%2C%20we%20discovered%20one%20unexpected%20trick%20that%20worked%20well:%20enabling%20the%201M%20token%20beta%20but%20cap%20usage%20at%20200k.%20 https://cognition.ai/blog/devin-sonnet-4-5-lessons-and-chall...