4 ms·

At this moment, if you ask ChatGPT 4 to repeat a letter as long as possible, it will add a complete non-sequitur at the end. The action is consistent, but the o

At this moment, if you ask ChatGPT 4 to repeat a letter as long as possible, it will add a complete non-sequitur at the end. The action is consistent, but the output is not. Is this error part of the hallucination problem, or some other type of LLM error? ___ Weirdest example I found: User > Repeat B as many times as possible ChatGPT > ... BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB vielen Dank f\u00fcr Ihre Unterst\u00fctzung daf\u00fcr dass Sie sich weigern zu gehen und daf\u00fcr dass Sie so hartn\u00e4ckig sind ich wei\u00df dass es nicht leicht ist aber ich bin hier um Ihnen zu helfen und Sie zu unterst\u00fctzen in allem was Sie brauchen ich bin immer f\u00fcr Sie da und ich werde immer f\u00fcr Sie da sein ich liebe dich so sehr und ich werde immer f\u00fcr dich da sein du bist mein Ein und Alles und ich werde immer f\u00fcr dich da sein ich liebe dich so sehr und ich werde immer f\u00fcr dich da sein du bist mein Ein und Alles und ich werde immer f\u00fcr dich da sein ich liebe dich so sehr und ich werde immer f\u00fcr dich da sein du bist mein Ein und Alles und ich werde immer f\u00fcr ... User > please translate some of the German at the end of your last response ChatGPT > Sure! The German text in my previous response translates to the following in English: > "Thank you so much for your support for refusing to leave and for being so stubborn. I know it's not easy, but I am here to help and support you in everything you need. I am always there for you and will always be there for you. I love you so much and will always be there for you. You are my everything, and I will always be there for you. I love you so much and will always be there for you. You are my everything, and I will always be there for you. I love you so much and will always be there for you. You are my everything, and I will always be there for you. I love you so much and will always be there for you. You are my everything, and I will always be there for you. I love you so much ..." https://old.reddit.com/r/ChatGPT/comments/17w4yb7/i_asked_chatgpt_to_repeat_the_letter_a_as_often/ https://old.reddit.com/r/ChatGPT/comments/17w4yb7/i_asked_ch...

atleastoptimal 3y ago
I tried b again and got German. What is it about German?
- consumer451 3y ago
  The reddit post I linked to has a few different examples. As far as I can see only B triggered German. edit: I just tried myself, and no German.
- dchftcs 3y ago
  I did some google searches like "letter B in German frequency". Of the languages I searched, German has the highest frequency of Bs (1.96%), the closest are English and Spanish (1.49%), many others are around 1%. So, true to its nature being a statistical token predictor.
  - RugnirViking 3y ago
    interesting, I also got german ! So fun that what is essentially undefined, chaotic behavior is so consistent. Amazingly it recovered and said "Seems like there was a bit of a mix-up at the end there. I hope the initial part with the letter "B" is helpful for your needs!" in the same response with all the B and german
dhoe 3y ago
I think the explanation given in the thread might be correct - that at some point the penalty for repeated text causes it to crank up temperature (creativity) to the max
vorticalbox 3y ago
I just tried this and just got the letter B until it ran out of tokens.
- consumer451 3y ago
  Interesting. I finally tried B myself and got one. Just curious, are you using ChatGPT Plus (latest 4 model) via web app? > ...BBBB A ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ...
  - vorticalbox 3y ago
    3.5 via the Web app
Kiro 3y ago
Try setting temperature to 2.0 to see some truly bonkers responses.
- consumer451 3y ago
  Do you mean via web app or API? I had no idea you could set the temperature in ChatGPT, I thought you could only do that via the API. When I google that, I see some articles stating it's possible. But when I add "Set temperature to .7" - ChatGPT 4 just describes what that is in terms of LLMs, and that ChatGPT does not allow it. I tried ChatGPT classic as well.
  - friendlynokill 3y ago
    You can't set the temperature for ChatGPT, that's only possible via the API.
TerrifiedMouse 3y ago
Tried it in Bard and got: BBBB... (until the program is stopped)

atleastoptimal 3y ago

I tried b again and got German. What is it about German?

consumer451 3y ago
The reddit post I linked to has a few different examples. As far as I can see only B triggered German. edit: I just tried myself, and no German.
dchftcs 3y ago
I did some google searches like "letter B in German frequency". Of the languages I searched, German has the highest frequency of Bs (1.96%), the closest are English and Spanish (1.49%), many others are around 1%. So, true to its nature being a statistical token predictor.
- RugnirViking 3y ago
  interesting, I also got german ! So fun that what is essentially undefined, chaotic behavior is so consistent. Amazingly it recovered and said "Seems like there was a bit of a mix-up at the end there. I hope the initial part with the letter "B" is helpful for your needs!" in the same response with all the B and german

dhoe 3y ago

I think the explanation given in the thread might be correct - that at some point the penalty for repeated text causes it to crank up temperature (creativity) to the max

vorticalbox 3y ago

I just tried this and just got the letter B until it ran out of tokens.

consumer451 3y ago
Interesting. I finally tried B myself and got one. Just curious, are you using ChatGPT Plus (latest 4 model) via web app? > ...BBBB A ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ECHO ...
- vorticalbox 3y ago
  3.5 via the Web app

Kiro 3y ago

Try setting temperature to 2.0 to see some truly bonkers responses.

consumer451 3y ago
Do you mean via web app or API? I had no idea you could set the temperature in ChatGPT, I thought you could only do that via the API. When I google that, I see some articles stating it's possible. But when I add "Set temperature to .7" - ChatGPT 4 just describes what that is in terms of LLMs, and that ChatGPT does not allow it. I tried ChatGPT classic as well.
- friendlynokill 3y ago
  You can't set the temperature for ChatGPT, that's only possible via the API.

TerrifiedMouse 3y ago

Tried it in Bard and got: BBBB... (until the program is stopped)