3 ms·
If the context window grows from 32k to 1m, maybe the entire history would fit in context. It could become a cost concern though.
by pstorm 4y ago
If the context window grows from 32k to 1m, maybe the entire history would fit in context. It could become a cost concern though.
- jbkkd 4y agoI'd be willing to pay good money for a 1m limit.