4 ms·
How long before they will raise the amount of context it can hold? Or, it there a ceiling that we can't go passed?
by altern8 5mo ago
How long before they will raise the amount of context it can hold?
Or, it there a ceiling that we can't go passed?
- disgruntledphd2 5mo agoThe context length scales quadratically in terms of compute, so barring algorithmic improvements, there's definitely a limit.
- altern8 5mo agoOK, so we'll have to deal with this for a good while