2 ms·

but you do sure see the problem with a codebase right?

• WithinReason 4y ago
  The current token limit comes from a O(N^2) memory requirements for N tokens, there is research that's trying to reduce this towards O(N), for example as the (downvoted) sibling comment suggests. This is not exactly straightforward but not impossible either. It's not a fundamental limitation of language models going forward.
  • jhoelzel 4y ago
    that still will only be enough to hold an extended cli application