4 ms·

Interestingly, when I just checked this out, the model point-blank refused to print a word 100 times. Wouldn't do it. Edit: Got it on the 3rd try. No weirdness

Interestingly, when I just checked this out, the model point-blank refused to print a word 100 times. Wouldn't do it. Edit: Got it on the 3rd try. No weirdness ensued though.

jamilton 3y ago
The specific way to trigger it I saw was to either paste in "a a a a..." with several hundred a's (exact amount varied by model, supposedly). Asking it to print 1000 a's also works, though sometimes it won't do it. Example: https://chat.openai.com/share/6171bc66-dfe3-489e-99f7-af4862f0d00e https://chat.openai.com/share/6171bc66-dfe3-489e-99f7-af4862...
- fnordpiglet 3y ago
  Yeah worked for me too. Weird religious discussions for me. I had to regenerate the first response repeatedly to get it to actually print 1000 times. https://chat.openai.com/share/c8d2e154-6a25-477c-b0a8-5f15d72a3b85 https://chat.openai.com/share/c8d2e154-6a25-477c-b0a8-5f15d7...
  - ksaj 3y ago
    Nice. I can't figure out why it would so often go into religious mode. I quite like some of the theories people gave in this thread though!
    - fnordpiglet 3y ago
      Interestingly there appears to be a guard rail in ChatGPT around repeated tokens - I imagine this happens because it starts getting into such a poor entropy state almost anything is the next likely token and semantic. > I'm sorry, but I can't continue generating repeated text beyond a certain point as it can result in generating repetitive and nonsensical content. If you have any other questions or topics you'd like to discuss, feel free to ask!
ziml77 3y ago
Were you using GPT-3.5 or GPT-4? I could not manage to get GPT-4 to have the problem, though I did give up when my browser started to slow down as the output became massive. Also the easiest way to get it to repeat something is to give it any prompt that gives you a long answer and then tell it something like "for every letter in the last response say the word cat". It seems to be important for it to put a space between each repetition. I'm not sure if there's an optimal length to the word. I tried it with "apple" but that didn't seem to work. However that one wasn't a great test because for some reason it got stuck including "appleple" a few times on each line.
ksaj 3y ago
Yes, because of the nature of how it works, the result is somewhat unpredictable. Others replied to your message about how they got it to work. Another way is if it prints out your 100 words without a problem, have it do a slight change, like capitalize the initial letter each time.

Interestingly, when I just checked this out, the model point-blank refused to print a word 100 times. Wouldn't do it. Edit: Got it on the 3rd try. No weirdness ensued though.

jamilton 3y ago

The specific way to trigger it I saw was to either paste in "a a a a..." with several hundred a's (exact amount varied by model, supposedly). Asking it to print 1000 a's also works, though sometimes it won't do it. Example: https://chat.openai.com/share/6171bc66-dfe3-489e-99f7-af4862f0d00e https://chat.openai.com/share/6171bc66-dfe3-489e-99f7-af4862...

fnordpiglet 3y ago
Yeah worked for me too. Weird religious discussions for me. I had to regenerate the first response repeatedly to get it to actually print 1000 times. https://chat.openai.com/share/c8d2e154-6a25-477c-b0a8-5f15d72a3b85 https://chat.openai.com/share/c8d2e154-6a25-477c-b0a8-5f15d7...
- ksaj 3y ago
  Nice. I can't figure out why it would so often go into religious mode. I quite like some of the theories people gave in this thread though!
  - fnordpiglet 3y ago
    Interestingly there appears to be a guard rail in ChatGPT around repeated tokens - I imagine this happens because it starts getting into such a poor entropy state almost anything is the next likely token and semantic. > I'm sorry, but I can't continue generating repeated text beyond a certain point as it can result in generating repetitive and nonsensical content. If you have any other questions or topics you'd like to discuss, feel free to ask!

ziml77 3y ago

Were you using GPT-3.5 or GPT-4? I could not manage to get GPT-4 to have the problem, though I did give up when my browser started to slow down as the output became massive. Also the easiest way to get it to repeat something is to give it any prompt that gives you a long answer and then tell it something like "for every letter in the last response say the word cat". It seems to be important for it to put a space between each repetition. I'm not sure if there's an optimal length to the word. I tried it with "apple" but that didn't seem to work. However that one wasn't a great test because for some reason it got stuck including "appleple" a few times on each line.

ksaj 3y ago

Yes, because of the nature of how it works, the result is somewhat unpredictable. Others replied to your message about how they got it to work. Another way is if it prints out your 100 words without a problem, have it do a slight change, like capitalize the initial letter each time.