3 ms·

Increasing the token limit without needing more resources to run the network is a solvable problem

• jhoelzel 4y ago
  but you do sure see the problem with a codebase right?
  • WithinReason 4y ago
    The current token limit comes from a O(N^2) memory requirements for N tokens, there is research that's trying to reduce this towards O(N), for example as the (downvoted) sibling comment suggests. This is not exactly straightforward but not impossible either. It's not a fundamental limitation of language models going forward.
    • jhoelzel 4y ago
      that still will only be enough to hold an extended cli application