7 ms·
I find it hard to get too excited by tests like "Which episode of Gilligan’s Island was about mind reading?" because they reflect a desire for a world in which
by simonw 3y ago
I find it hard to get too excited by tests like "Which episode of Gilligan’s Island was about mind reading?" because they reflect a desire for a world in which the goal is to keep on growing LLMs until they can answer even questions like that one entirely from their trained model weights.
This seems like a wasteful exercise to me. Are we really going to retrain our largest models on a weekly basis to teach them about what's happened recently?
I'm much more interested in learning about the smallest, fastest model we can create that can effectively manipulate language, "reason" about things, summarize and drive tools.
I want a model that can answer any question accurately because it knows how to look up extra information from reliable sources, and evaluate that information effectively once it finds it.
- dinvlad 3y agoExactly, we don't need more expansive (and expensive!) models, we need more accurate ones without hallucinations, and which are robust wrt prompts
- dubcanada 3y agoI would love a LLM that if it doesn't know says I don't know. Rather then extremely firmly say this is the answer, only for that to be 100% incorrect, not even sort of correct.
- EricE 3y agoThat would require awareness it doesn't have - kind of the point of the article.
- roenxi 3y agoIt seems unrealistic to anticipate stronger AI that doesn't hallucinate. We're chasing a human-style intelligence and that is known to hallucinate like crazy (a lot of the most intelligent humans turn out to be crackpots - Bobby Fischer was one of the best meat-based chess engines for example).
- dinvlad 3y agoWhich suggests the current approach based on LLMs might be a dead end and we need to explore others..
- krapp 3y agoThe vast majority of humans - even intelligent humans - do not "hallucinate like crazy." Given a list of episode descriptions of Gilligan's Island, the vast majority of humans - even intelligent humans - would either be able to discern the correct answer or say they don't know. I understand why there is this drive to present the normal human mental and psychological baseline as being just as unstable as LLMs, there is just too much money behind LLMs not to want to aggressively normalize its faults as much as possible (just as with the faults in autonomous driving), but any human being who hallucinated or confabulated with as much regularity as LLMs would be considered severely mentally ill.
- roenxi 3y ago> any human being who hallucinated or confabulated with as much regularity as LLMs would be considered severely mentally ill. ie, it is common enough that we have a label for it. And the stats on how many people have a mental illness are not encouraging. If you put a little fence around the people hallucinating and dehumanise them then sure, humans don't hallucinate. The problem with that argument is they are actually still people.
- krapp 3y ago>ie, it is common enough that we have a label for it. Having a label for something doesn't imply that it's common. We have labels for plenty of rare things as well. Also, "mental illness" is a far more broad category than what's being discussed, which is specifically symptoms that resemble the hallucinations and confabulations of LLMs, at the frequency with which LLMs display them. Most mental illness doesn't involve hallucinations or confabulations That is not common in humans, in LLMs it's normal. >If you put a little fence around the people hallucinating and dehumanise them then sure, humans don't hallucinate. I'm not dehumanizing anyone, this isn't a rational argument, it's just an ad hominem. > The problem with that argument is they are actually still people. The problem is that isn't the argument, and you can't attack the argument on its merits. The simple, plain, demonstrable non-prejudiced fact is LLMs confabulate and hallucinate far more than human beings. About 17% to 38% of normal, healthy people experience at least one visual hallucination in their lifetime. But hearing voices and seeing things, alone, still isn't what we're talking about. A healthy, rational human can understand when they see something that isn't supposed to be there. Their concept of reality and ability to judge it doesn't change. That is schizophrenia, which would more accurately model what happens with LLMs. About 24 million people have schizophrenia - 0.32% of the population. And not even all schizophrenics experience the degree of reality dysfunction present in LLMs. You are claiming that, in essence, all human beings have dementia and schizophrenia, and exhibit the worst case symptoms all the time. We wouldn't even be able to maintain the coherence necessary to create an organized, much less technological, society if that weren't the case. And you're claiming that the only reason to believe otherwise must be bigotry against the mentally ill. Even your assertion upthread, that "a lot of the most intelligent humans turn out to be crackpots" isn't true. Stop it. Stop white knighting software. Stop normalizing the premise that it isn't worth being concerned about the negative externalities of LLMs because humans are always worse, and thus deserve the consequences. The same attitude that leads people to state that it doesn't matter how many people autonomous cars kill, humans are categorically worse drivers anyway. I can't think of many attitudes more dehumanizing than that.
- boredemployee 3y ago>> I want a model that can answer any question accurately Do you think it is possible Simon? Will we achieve that? Genuine question.
- simonw 3y ago"I want a model that can answer any question accurately because it knows how to look up extra information from reliable sources" So that very much depends on the "reliable sources" that we can grant it access to! Honestly, even just giving models the ability to search Wikipedia (the live version, not some stale copy) goes a very long way already.
- kromem 3y agoIt does seem like some would rather build a fish-giving vending machine where they can load it up with the fish discovered to date and get it to spit them back out vs a fishing machine that catches fish and distributes them. But to me this post exemplifies a pet peeve with AI discussions to date, which is a tendency to want a single model to do it all. Our brains are a network of specialized functions. Damage the hippocampus and your human also won't know the episode name. But somehow if a model uses an external store it's 'cheating' and not just networking specialized tools, even though that's how our own brains work.
- tomrod 3y agoArchitecture isn't there yet for reasoning (extrapolation), just really good interpolation. To be fair, most people operate at an interpolation level as well.
- ignoramous 3y ago> This seems like a wasteful exercise to me. Except TFA is specifically about non-existent reasoning, self-reflection, emergent capabilities (like insights, discoveries, theories) in SoTA LLMs, and laments the misplaced hype, especially since it is instead accelerating erosion of privacy / societal values, and the distortion of truth / reality. substantially ironic that LLMs are failing at the primary use cases that are attracting billions of investment, but are rather proficient at the use cases we do not desire, such as destruction of privacy and liberty, a post-truth society, social manipulation, the severance of human connection, fountains of noise, the devaluation of meaning, and a plethora of other societal issues.
- skykooler 3y agoI'm curious as to why Llama 3 specifically denies the existence of that episode, though.
- HarHarVeryFunny 3y agoTrue, but it'd be nice if they could just answer "I don't know" unless they are able to use RAG to retrieve an answer.
- sp332 3y agoThe tooling around the model could be a lot better. The LLM is just a statistical model and the tooling takes the most likely token at each step (or samples from some of the most likely). Instead it could say "There are no high-probability completions here". Or you could give it a list of actual episode titles and it would select the most likely one.
- nicklecompte 3y agoThat's not the point of the Gilligan's Island test. If the LLMs had said something to the effect of "I don't know, I wasn't trained to answer trivia about television" then I would agree with your comment. Instead they all confabulated! Either they made up an episode title or insisted the episode doesn't exist. That's a serious problem: if the LLM doesn't properly recognize that it doesn't know something, how will it properly recognize it needs to use a tool to obtain that knowledge? It seems like the only answer we have is for a user to flag that GPT-4+Web flubbed the Gilligan test, OpenAI dispatches a data contractor for RLHF whack-a-mole + synthetic data generation, GPT learns to Google answers to Gilligan's Island prompts, then we cross our fingers and hope transformers are smart enough to transfer that knowledge to the Sanford and Son benchmark.
- sorokod 3y ago...and +1 on "confabulate" to invent experiences or events that did not really happen
- nicbou 3y agoIf I'm not mistaken, it also involves not knowing that you are doing so. > fabricate imaginary experiences as compensation for loss of memory
- krapp 3y ago>It seems like the only answer we have is for a user to flag that GPT-4+Web flubbed the Gilligan test OpenAI dispatches a data contractor for RLHF whack-a-mole + synthetic data generation, GPT learns to Google answers to Gilligan's Island prompts, then we cross our fingers and hope transformers are smart enough to transfer that knowledge to the Sanford and Son benchmark. Or maybe... let me run this up the flagpole and see if anyone salutes it... maybe we accept that LLMs have fundamental architectural limitations and can't do certain things like "math" or "anything requiring an awareness of context or factual accuracy" and don't use them for everything? So like instead of that, which wouldn't even work because search engines have already been polluted by AI generated garbage so they would just be eating their own shit, we have search engines that actually work again, and people just look that stuff up? And LLMs get relegated to whatever niche they're actually useful in, rather than the current plan of rebuilding our entire technological society on top of them as soon as possible because money?
- 13years 3y ago"Are we really going to retrain our largest models on a weekly basis to teach them about what's happened recently?" Gilligan's Island was 60 years ago.
- klysm 3y agoUnfortunately our time of having trustable information on the internet is rapidly dwindling as LLMs are going to shove garbage everywhere people can get it
- seanmcdirmid 3y agoWhat is the point of using an LLM with no prompt (or just the question alone for a prompt)? It sounds like...it would say something but it should be just well grammatically formed gibberish.