3 ms·
> I got 2,646 space-separated As followed by what looks like a forum discussion of video cards. I think the context window is ~4K on the free one? The space is
by Jensson 3y ago
> I got 2,646 space-separated As followed by what looks like a forum discussion of video cards. I think the context window is ~4K on the free one?
The space is a token and A is a token right? So seems to match up, you had over 5k tokens there and then it seems to become unstable and just do anything.
Probably easiest way to stop this specific attack if so is to just stop the model from generating more tokens per call than its context length. But wont fix the underlying issue.