3 ms·

It has already been trained on all the data. The other obvious next step is to increase context window, but that's apparently very hard/costly.

• theptip 1y ago
  I don’t think this is true. See https://arxiv.org/html/2211.04325v2 https://arxiv.org/html/2211.04325v2 for example.
  • mmcnl 1y ago
    There are diminishing returns.