3 ms·
That has been our finding, it seems that we are able to do larger sessions in a single context window because of the lessened bloat. Certainly needs wider sprea
by bennettdixon 6mo ago
That has been our finding, it seems that we are able to do larger sessions in a single context window because of the lessened bloat. Certainly needs wider spread testing though which is why we are excited to get more feedback.