4 ms·
The context length scales quadratically in terms of compute, so barring algorithmic improvements, there's definitely a limit.
by disgruntledphd2 6mo ago
The context length scales quadratically in terms of compute, so barring algorithmic improvements, there's definitely a limit.
- altern8 6mo agoOK, so we'll have to deal with this for a good while