3 ms·

I consulted ChatGPT about a bank issue. I didn't have a phone number but ChatGPT was able to spill out a number with a recommendationto call. I verified the num

I consulted ChatGPT about a bank issue. I didn't have a phone number but ChatGPT was able to spill out a number with a recommendationto call. I verified the number and it was indeed correct (easy: google the number) I couldn't find the number with searches (I tried before) and I didn't even know that it might be helpful (didn't find it before, so how could I tell) but the AI spilled out and told me how useful it is. This made me change my mind on search vs. AI. I got what I needed while I was unable to retrieve it with search. It was at least a 10x improvement over search. But I do think there is space for both.

musha68k 4y ago
The compression can be lossy though and the model often “predicts” complete garbage even with GPT-4. It would be great to get a probability for correctness “Mr. Spock” style in chat - especially so as in case of a telephone number…
- ravenstine 4y ago
  You can ask it to also provide a confidence score, though I found it biases heavily towards a high score.
  - fuzzfactor 4y ago
    There is an 84% chance we will encounter the force field and become vaporized instantly, Captain. And rising. What action would you recommend?
  - K0IN 4y ago
    this is also hard for humans. Even with a n shot example this needs complex understanding (same is true for similarity i think). try yourself ask a random person the similarity between two sentences, without giving them a ruleset or examples. Even with examples the result very from person to person.
ravenstine 4y ago
Yeah there is no way I'm giving up my Kagi subscription just yet. I don't really see ChatGPT as a search engine because I think that's not its strength, though it can certainly deliver in that area sometimes. I like using ChatGPT to clarify information I already have some idea about, and just need a straight forward summary for. This is different than asking it for specific shreds of information. If you treat ChatGPT as an intelligence and not a robot performing reflex over the internet, it's going to be correct often enough. But you always gotta use your head. I don't ask ChatGPT anything that's too far out of my domain of knowledge because, if it gets something wrong, I won't have the Spidey senses to realize it.
fuzzfactor 4y ago
When it comes to diagnosing disease or something, how is AI alone going to compete with a top physician? I'm talking about a top physician who is of course a leader at using the AI to leverage his own advanced skills, along with contributing to the enhanced training of the model as they go along in a way where each physician's unique input can leverage each other's. Man in the loop > Loop with no man

musha68k 4y ago

The compression can be lossy though and the model often “predicts” complete garbage even with GPT-4. It would be great to get a probability for correctness “Mr. Spock” style in chat - especially so as in case of a telephone number…

ravenstine 4y ago
You can ask it to also provide a confidence score, though I found it biases heavily towards a high score.
- fuzzfactor 4y ago
  There is an 84% chance we will encounter the force field and become vaporized instantly, Captain. And rising. What action would you recommend?
- K0IN 4y ago
  this is also hard for humans. Even with a n shot example this needs complex understanding (same is true for similarity i think). try yourself ask a random person the similarity between two sentences, without giving them a ruleset or examples. Even with examples the result very from person to person.

ravenstine 4y ago

Yeah there is no way I'm giving up my Kagi subscription just yet. I don't really see ChatGPT as a search engine because I think that's not its strength, though it can certainly deliver in that area sometimes. I like using ChatGPT to clarify information I already have some idea about, and just need a straight forward summary for. This is different than asking it for specific shreds of information. If you treat ChatGPT as an intelligence and not a robot performing reflex over the internet, it's going to be correct often enough. But you always gotta use your head. I don't ask ChatGPT anything that's too far out of my domain of knowledge because, if it gets something wrong, I won't have the Spidey senses to realize it.

fuzzfactor 4y ago

When it comes to diagnosing disease or something, how is AI alone going to compete with a top physician? I'm talking about a top physician who is of course a leader at using the AI to leverage his own advanced skills, along with contributing to the enhanced training of the model as they go along in a way where each physician's unique input can leverage each other's. Man in the loop > Loop with no man