4 ms·
> ChatGPT got everything correct My anecdote with technical information is exactly the opposite, unfortunately. I routinely use it to help guide my research -
by Alupis 3y ago
> ChatGPT got everything correct
My anecdote with technical information is exactly the opposite, unfortunately.
I routinely use it to help guide my research - generally about topics I know something about but want to know more.
It often will provide some response that is entirely wrong but looks very good. When called out, it apologizes, then proceeds to produce more information that's also not entirely correct. There's an artform to teasing out the right answer... but of course you have to be knowledgeable enough to know what is right in the first place.
The subtleties of correct or wrong can be very difficult to determine for a layperson. Without deep knowledge, one might be inclined to believe the first response it provides.
That's pretty terrifying when you think of the possible implications revolving around research, law, etc.
- consumer451 3y agoI have had similar experiences in other areas, that's why I didn't try an LLM before spending hours researching. But I must say that I was shocked at the accuracy in that one particular area... Harris County estate law. What is the difference here? No hallucinations, everything correct… is it just random chance?
- LouisSayers 3y agoI'm having the same issues with it getting things confidently incorrect. The flow I've been going through: * Do this task with this constraint > GPT4 Does task * Analyse all of the items and whether they adhere to the constraint > GPT4 "Apologies, I got some things wrong, here's what I did incorrect" * Fix the things you did wrong, remember the constraint is of upmost importance > GPT4 "I have completed the task and fixed the constraint * Analyse all of the items and whether they adhere to the constraint > GPT4 "Apologies, I got some things wrong, here's what I did incorrect" ... At least it can analyse the results, but even then if you don't ask in the right way it will blatantly lie to you and tell you it's all correct when it's not.
- nicce 3y agoI have found the very similar issues. But on programming language and other logical question areas it does not matter much, as you can verify with logic if something is correct, and then it is incredible useful
- shriek 3y agoLikewise, same result for me too but I get it. It's a language model. It makes a best guess based on the information it was provided so I trust it on the things I'm familiar with but verify on those that I'm not.
- earth-adventure 3y agoI'm really stunned by the fact that, it seems, so few people get this. It's not a robot in the dense of Commander Data from Star Trek. It's a recursive software method that just has unfathomable amounts of data to base it's guess for some correct sentences on. There is no logic, no reasoning, no nothing. Yet people complain it's 'giving me wrong answers'. Well, it doesn't know what's it's giving you either way. It only knows the statistics or odds about the sentences it creates being similar to what others have said before.
- tropicalbeach 3y agoYou could say the same about your brain. You predict the best thing to say at the moment all the time. You make predictions off everything you do.
- hnfong 3y agoAnd "Free Will" is the observation of one's inability to predict one's own actions. As an aside, the claims that people are willing to make about language models are quite astounding considering that they never seem to realize that most of those claims apply to humans also...
- renewiltord 3y agoYeah, it's true. Even today, I notice that I can often find things using Google while other people can't. I guess it's just a skill and some people lack it.