5 ms·
> does not constitute fully general intelligence but the difficult part has been finding things that they cannot do I am very surprised when people say things
by aydyn 2y ago
> does not constitute fully general intelligence but the difficult part has been finding things that they cannot do
I am very surprised when people say things like this. For example, the best ChatGPT model continues to lie to me on a daily basis for even basic things. E.g. when I ask it to explain what code is contained on a certain line on github, it just makes up the code and the code it's "explaining" isn't found anywhere in the repo.
From my experience, every model is untrustworthy and full of hallucinations. I have a big disconnect when people say things like this. Why?
- daniel_iversen 2y agoI’m splitting hairs a little bit but I feel like there should be a difference in how we think about current “hard(er)” limitations of the models vs limits in general intelligence and reasoning, I.e I think the grandparent comment is talking about overall advancement in reasoning and logic and in that finding things AI “cannot do” whereas you’re referring to what is more classify as a “known issue”. Of course it’s an important issue that needs to get fixed and yes technically until we don’t have that kind of issue we can’t call it “general intelligence” but I do think the original comment is about something different than a few known limitations that probably a lot of models have (and that frankly you’d have thought wouldn’t be that difficult to solve!?)
- aydyn 2y agoYes but I am just giving an example of something recent, I could also point to pure logic errors if I go back and search my discussions. Maybe you are on to something for "classifying" issues; the type of problems LLMs have are hard to categorize and hence it is hard to benchmark around. Maybe it is just a long tail of many different categories of problems.
- lovemenot 2y agoI am not an expert, but I suspect the disconnect concerns number of data sources. LLMs are good at generalising over many points of data, but not good at recapitulating a single data point like in your example.
- neverokay 2y agoIt does this even if you give it instructions to make sure the code is truly in the code base? You never told it can’t lie.
- idiotsecant 2y agoTelling a LLM 'do not hallucinate' doesn't make it stop hallucinating. Anyone who has used an LLM even moderately seriously can tell you that. They're very useful tools, but right now they're mostly good for writing boilerplate that you'll be reviewing anyhow.
- szundi 2y agoFunnily if you routinely ask them wether their answer is right, they fix it or tell you they hallucinated
- rasz 2y agoApple doesnt believe you https://www.pcmag.com/news/apple-intelligence-prompts-warn-the-ai-do-not-hallucinate https://www.pcmag.com/news/apple-intelligence-prompts-warn-t... :)
- pizza 2y agoWell, language models don't measure the state of the world - they turn your input text into a state of text dynamics, and then basically hit 'play' on a best guess of what the rest of the text from that state would contain. Part of your getting 'lies' is that you're asking questions for which the answer couldn't really be said to be contained anywhere inside the envelope/hull of some mixture of thousands of existing texts. Like, suppose for a thought experiment, that you got ten thousand random github users, collected every documented instance of a time that they had referred to a line number of a file in any repo, and then tried to use those related answers to come up with a mean prediction for the contents of a wholly different repo. Odds are, you would get something like the LLM answer. My opinion is that it is worth it to get a sense, through trial and error (checking answers), of when a question you have may or may not be in a blindspot of the wisdom of the crowd.
- szundi 2y ago[dead]
- Lerc 2y agoFor clarity, could you say exactly what model you are using? The very best ChatGPT model would be a very expensive way to perform that sort of task.
- dash2 2y agoIs this a version of ChatGPT that can actually go and check on the web? If not it is kind of forced to make things up.