4 ms·
Can you reproduce irreproducibility? Give me a question which the LLM answers vastly differently on runs. I keep hearing how it's dumb and wrong but no one ev
by bko 4mo ago
Can you reproduce irreproducibility?
Give me a question which the LLM answers vastly differently on runs.
I keep hearing how it's dumb and wrong but no one ever shares the chat or prompt
- uxhacker 4mo agoTry this with ChatGPT or GROK or Claude How many days of the week contain the letter d? The answer I get with ChatGPT, and Grok is 3 and 6 with Claude.
- jagged-chisel 4mo agoI just used ChatGPT only, twice. Web interface in a Firefox private window, and in a Chrome incognito window. I asked them both the identical question "How many names of the days of the week contain the letter D?" In Firefox I got 6. In Chrome I got 7. LLMs are not even self-consistent. I have the screenshots if anyone cares.
- jagged-chisel 4mo agoYes. https://news.ycombinator.com/item?id=48420769 https://news.ycombinator.com/item?id=48420769