3 ms·

Are there any drawbacks to the larger context window? Like more hallucinations or lower speed?

someplaceguy 3y ago
> Are there any drawbacks to the larger context window? Yes. When you say something stupid, ChatGPT won't forget it as easily...
- zamadatix 3y ago
  Generally I just go back and edit that message to clear the slate. At best, even if it does ignore the message it needlessly eats up context window to have it in there.
Der_Einzige 3y ago
Even full quadratic attention models seem to forget or not value information given in the middle of the prompt. Anything using any kind of context length widening tricks which cripple the attention in some way (which is usually how this is done) will make that problem worse. - https://arxiv.org/abs/2307.03172 https://arxiv.org/abs/2307.03172 You can see this when you use Anthropic Claude which has a 100K context length today.
- razodactyl 3y ago
  Neural Networks are very lazy - due to the nature of optimising to reduce error they will do ONLY what's required to solve the problems provided in their data. I have a feeling this will become a non-issue in the near future as the models are further trained with this in mind. Take an undertrained model for example: It starts becoming incoherent as you approach the context length - I have a theory that OpenAI models have been running at a larger block-size than presented for a while now - for example, "4K" models actually had 8K context but capped at 4K as anything beyond starts becoming incoherent: Reason being, you train to around 5K and don't let the user go near that section of the model and it gives the impression that the entire context block is 100% functional. The solution is trivial: You bootstrap the models by having them generate training data after they reach a certain point. I wrote one from the ground up (PyTorch only) with the intention of having it perform in constrained environments and these have been my findings over the last few months.
zer0c00ler 3y ago
Yes, a prompt injection will persist longer and can have impact later in a conversation for instance.

> Are there any drawbacks to the larger context window? Yes. When you say something stupid, ChatGPT won't forget it as easily...

zamadatix 3y ago
Generally I just go back and edit that message to clear the slate. At best, even if it does ignore the message it needlessly eats up context window to have it in there.

Der_Einzige 3y ago

Even full quadratic attention models seem to forget or not value information given in the middle of the prompt. Anything using any kind of context length widening tricks which cripple the attention in some way (which is usually how this is done) will make that problem worse. - https://arxiv.org/abs/2307.03172 https://arxiv.org/abs/2307.03172 You can see this when you use Anthropic Claude which has a 100K context length today.

razodactyl 3y ago
Neural Networks are very lazy - due to the nature of optimising to reduce error they will do ONLY what's required to solve the problems provided in their data. I have a feeling this will become a non-issue in the near future as the models are further trained with this in mind. Take an undertrained model for example: It starts becoming incoherent as you approach the context length - I have a theory that OpenAI models have been running at a larger block-size than presented for a while now - for example, "4K" models actually had 8K context but capped at 4K as anything beyond starts becoming incoherent: Reason being, you train to around 5K and don't let the user go near that section of the model and it gives the impression that the entire context block is 100% functional. The solution is trivial: You bootstrap the models by having them generate training data after they reach a certain point. I wrote one from the ground up (PyTorch only) with the intention of having it perform in constrained environments and these have been my findings over the last few months.

zer0c00ler 3y ago

Yes, a prompt injection will persist longer and can have impact later in a conversation for instance.