4 ms·
3.5 was all about context window management. The second you hit that wall it became useless. I would either chunk the problem into smaller pieces or rollover my
by protocolture 1y ago
3.5 was all about context window management. The second you hit that wall it became useless. I would either chunk the problem into smaller pieces or rollover my context every hour or so and it worked a treat.
The second it started dropping context it was hilariously unreliable. It would just, rewrite the entire function or drop elements we hadnt discussed for a while.
- kragen 1y agoI see, thanks!