4 ms·

I am not the OP, an I have only used ChatGPT free version. Last day I asked it something. It answered. Then I asked it to provide sources. Then it provided sour

by qsera 7mo ago

I am not the OP, an I have only used ChatGPT free version. Last day I asked it something. It answered. Then I asked it to provide sources. Then it provided sources, and also changed its original answer. When I checked the new answers it was wrong, and when I checked sources, it didn't actually contain the information that I asked for, and thus it hallucinated the answers as well as the sources...

simianwords 7mo ago
I trust you. If it were happening so frequently you may be able to give me a single prompt to get it to bullshit?
- the_snooze 7mo ago
  I did this in one attempt just now: https://gemini.google.com/share/b4e016be1f69 https://gemini.google.com/share/b4e016be1f69 #8 has an incorrect answer (3 appearances according to Gemini, 2 according to reality https://en.wikipedia.org/wiki/Bowl_championship_series#BCS_appearances_by_team https://en.wikipedia.org/wiki/Bowl_championship_series#BCS_a...) So it works well 95% of the time for literally a trivial use case. Imagine if any other tech tool had that kind of reliability: `ls` displays 95% of your files, your phone successfully sends and receives 95% of text messages, or Microsoft Word saving 95% of the characters you typed in. That's just not acceptable.
  - simianwords 7mo ago
    Hi! The challenge was ChatGPT but even then it looks like you used the weakest version of Gemini.
    - the_snooze 7mo ago
      >I stress test commercially deployed LLMs like Gemini and Claude with trivial tasks I did exactly what I said I did. I'm using these systems the way they're designed and advertised. I'm following the happy path with tasks that are small, trivial, and easy to check. This is the charitable approach. Yet the system creaks under the lightest load. If Google wants to put on a better show with stronger models, then they should make those the default. You don't need to make excuses for shoddy engineering from multi-billion dollar corporations. And you're quite welcome to run the same prompt on ChatGPT and evaluate it on your own time.
      - simianwords 7mo ago
        Yeah its not too interesting to complain about mistakes from the cheapest model.

by qsera 7mo ago

simianwords 7mo ago

I trust you. If it were happening so frequently you may be able to give me a single prompt to get it to bullshit?

the_snooze 7mo ago
I did this in one attempt just now: https://gemini.google.com/share/b4e016be1f69 https://gemini.google.com/share/b4e016be1f69 #8 has an incorrect answer (3 appearances according to Gemini, 2 according to reality https://en.wikipedia.org/wiki/Bowl_championship_series#BCS_appearances_by_team https://en.wikipedia.org/wiki/Bowl_championship_series#BCS_a...) So it works well 95% of the time for literally a trivial use case. Imagine if any other tech tool had that kind of reliability: `ls` displays 95% of your files, your phone successfully sends and receives 95% of text messages, or Microsoft Word saving 95% of the characters you typed in. That's just not acceptable.
- simianwords 7mo ago
  Hi! The challenge was ChatGPT but even then it looks like you used the weakest version of Gemini.
  - the_snooze 7mo ago
    >I stress test commercially deployed LLMs like Gemini and Claude with trivial tasks I did exactly what I said I did. I'm using these systems the way they're designed and advertised. I'm following the happy path with tasks that are small, trivial, and easy to check. This is the charitable approach. Yet the system creaks under the lightest load. If Google wants to put on a better show with stronger models, then they should make those the default. You don't need to make excuses for shoddy engineering from multi-billion dollar corporations. And you're quite welcome to run the same prompt on ChatGPT and evaluate it on your own time.
    - simianwords 7mo ago
      Yeah its not too interesting to complain about mistakes from the cheapest model.