3 ms·
Good on them for resolving all three issues, but is it any good again?
by setnone 5mo ago
Good on them for resolving all three issues, but is it any good again?
- alxndr13 5mo agofor me at least, yes. just wrote it to coworkers this afternoon. Behaves way more "stable" in terms of quality and i don't have the feeling of the model getting way worse after 100k tokens of context or so. What i notice: after 300k there's some slight quality drop, but i just make sure to compact before that threshold.