4 ms·
Neat idea. But GPT itself has context length limit, so it is not infinite? At some point the list will go rogue and becomes irrelevant.
by karmasimida 4y ago
Neat idea. But GPT itself has context length limit, so it is not infinite? At some point the list will go rogue and becomes irrelevant.
- visarga 4y agoIf you have a prompt with demonstrations (in-context-learning) you can randomly sample the demonstrations from a larger dataset. This will make the model generate more variations as you are introducing some randomness in the prompt.
- ianbicking 4y agoThere's a maximum context of 10 items so it won't ever technically stop (though your GPT bill will keep going up). For something clearly ordered this might be enough, e.g., primes[100:110] will give a context of primes[90:100] which might give you the correct next primes. (Everything in this library is a "might".) For something like the book example I expect once you get to item 12 it might repeat item 0 since that won't be included in the examples.