4 ms·
LLMs aren't good at being search engines, they're good at understanding things. Put an LLM on top of a search engine, and that's the appropriate tool for this u
by stavros 2y ago
LLMs aren't good at being search engines, they're good at understanding things. Put an LLM on top of a search engine, and that's the appropriate tool for this use case.
I guess the problem with LLMs is that they're too usable for their own good, so people don't realizing that they can't perfectly know all the trivia in the world, exactly the same as any human.
- MegaButts 2y ago> LLMs aren't good at being search engines, they're good at understanding things. LLMs are literally fundamentally incapable of understanding things. They are stochastic parrots and you've been fooled.
- more_corn 2y agoFor them to work at all they need to have some representation of concepts. Recent research at anthropic has shown a surprising complexity in their reasoning behavior. Perhaps the parrot here is you.
- bobsmooth 2y agoWhat do you call someone that mentions "stochastic parrots" every time LLMs are mentioned?
- MegaButts 2y agoIt's the first time I've ever used that phrase on HN. Anyway, what phrase do you think works better than 'stochastic parrot' to describe how LLMs function?
- karn97 2y agoTry to come up with a way to prove humans aren't stochastic parrots then maybe people will atart taking you seriously. Just childish reddit angst rn nothing else.
- bluefirebrand 2y ago> Try to come up with a way to prove humans aren't stochastic parrots Look around you Look at Skyscrapers. Rocket ships. Agriculture. If you want to make a claim that humans are nothing more than stochastic parrots then you need to explain where all of this came from. What were we parroting? Meanwhile all that LLMs do is parrot things that humans created
- jodrellblank 2y agoSkyscrapers: trees, mountains, cliffs, caves in mountainsides, termite mounds, humans knew things could go high, the Colosseum was built two thousand years ago as a huge multi-storey building. Rocket ships: volcanic eruptions show heat and explosive outbursts can fling things high, gunpowder and cannons, bellows showing air moves things. Agriculture: forests, plains, jungle, desert oases, humans knew plants grew from seeds, grew with rain, grew near water, and grew where animals trampled them into the ground. We need a list of all atempted ideas, all inventions and patents that were ever tried or conceived, and then we see how inventions are the same random permutations on ideas with Darwinian style survivorship as everything else; there were steel boats with multiple levels in them before skyscrapers; is the idea of a tall steel building really so magical when there were over a billion people on Earth in 1800 who could have come up with it?
- meroes 2y agoYou’re likening actual rocketry to LLMs being mildly successful at describing Paul Newman’s alcohol use on average when they already have the entire internet handed to them.
- bluefirebrand 2y ago> when there were over a billion people on Earth in 1800 who could have come up with it My point is that humans did come up with it. Humans did not parrot it from someone or something else that showed it to us. We didn't "parrot" splitting the atom. We didn't learn how to build skyscrapers from looking at termite hills and we didn't learn to build rockets that can send a person to the moon from seeing a volcano You are just speaking absolute drivel
- brookst 2y agoIt’s good rhetoric but bad analogy. LLMs can be very creative (to the point of failure, in hallucinations). I don’t know if there is a pithy shirt phrase to accurately describe how LLMs function. Can you give me a similar one for how humans think? That might spur my own creativity here.
- fancyfredbot 2y agoThat makes me think, has anyone ever heard of an actual parrot which wasn't stochastic? I'm fairly sure I've never seen a deterministic parrot which makes me think the term is tautological.
- fancyfredbot 2y agoWe're talking about a stochastic parrot which in many circumstances responds in a way which is indistinguishable from actual understanding.
- MegaButts 2y agoI've always been amazed by this. I have never not been frustrated with the profound stupidity of LLMs. Obviously I must be using it differently because I've never been able to trust it with anything and more than half the time I fact check it even for information retrieval it's objectively incorrect.
- karn97 2y agoIts ok to be paranoid
- MegaButts 2y agoFact checking is paranoia?
- fancyfredbot 2y agoIf you got as far as checking the output it must have appeared to understand your question. I wouldn't claim LLMs are good at being factual, or good at arithmetic, or at drawing wine glasses, or that they are "clever". What they are very good at is responding to questions in a way which gives you the very strong impression they've understood you.
- MegaButts 2y agoI vehemently disagree. If I ask a question with an objective answer, and it simply makes something up and is very confident the answer is correct, what the fuck has it understood other than how to piss me off? It clearly doesn't understand that the question has a correct answer, or that it does not know the answer. It also clearly does not understand that I hate bullshit, no matter how many dozens of times I prompt it to not make something up and would prefer an admittance of ignorance.
- mitthrowaway2 2y agoWhat does the word "understand" mean to you?
- MegaButts 2y agoAn ability to answer questions with a train of thought showing how the answer was derived, or the self-awareness to recognize you do not have the ability to answer the question and declare as much. More than half the time I've used LLMs they will simply make answers up, and when I point out the answer is wrong it simply regurgitates another incorrect answer ad nauseum (regularly cycling through answers I've already pointed out are incorrect). Rather than give you a technical answer - if I ever feel like an LLM can recognize its limitations rather than make something up, I would say it understands. In my experience LLMs are just algorithmic bullshitters. I would consider a function that just returns "I do not understand" to be an improvement, since most of the time I get confidently incorrect answers instead. Yes, I read Anthropic's paper from a few days ago. I remain unimpressed until talking to an LLM isn't a profoundly frustrating experience.
- mitthrowaway2 2y agoI just want to say that's a much better answer than I anticipated!
- the8472 2y agoA stochastic parrot with a sufficiently tiny residual error rate needs a stochastic model so precisely compressing the world and sophisticated decompression algorithms that it could be called reasoning. Take two 4K frames of a falling vase, ask a model to predict the next token... I mean the following images. Your model now needs include some approximations of physics - and the ability to apply it correctly - to produce a realistic outcome. I'm not aware of any model capable of doing that, but that's what it would mean to predict the unseen with high enough fidelity.
- more_corn 2y agoIronically though an LLM powered search engine (some word about being perplexed) is becoming way better than the undisputed king of traditional search engines (something oogle)
- stavros 2y agoThat's because they put an LLM over a traditional search engine.
- aspenmayer 2y agoGoogle Labs has AI Mode now, apparently. https://labs.google.com/search/experiment/22 https://labs.google.com/search/experiment/22
- stavros 2y agoHm, that's not available to me, what is it? If its an LLM over Google, didn't they release that a few months ago already?
- aspenmayer 2y agoUS only for now may be the issue? It expands what they had before with AI Overviews, but I’m not sure how new either of those are. It showed up for me organically as an AI Mode tab on a native Google search in Firefox ironically. https://support.google.com/websearch/answer/16011537 https://support.google.com/websearch/answer/16011537
- stavros 2y agoVery interesting, thank you!
- aspenmayer 2y agoNo worries. What happens if you go directly to https://google.com/aimode https://google.com/aimode ?
- nyarlathotep_ 2y ago> I guess the problem with LLMs is that they're too usable for their own good, so people don't realizing that they can't perfectly know all the trivia in the world, exactly the same as any human. They're quite literally being sold as a replacement for human intellectual labor by people that have received uncountable sums of investment money towards that goal. The author of the post even says this: "These machines will soon become the beating hearts of the society in which we live. The social and political structures they create as they compose and interact with each other will define everything we see around us." Can't blame people "fact checking" something that's supposed to fill these shoes. People should be (far) more critical of LLMs given all of these style of bold claims, not less. Also, telling people they're "holding it wrong" when they interact with alleged "Ay Gee Eye" "superintelligence" really is a poor selling point, and no way to increase confidence in these offerings. These people and these companies don't get to make these claims that threaten the livelihood of millions of people, inflate a massive bubble, impact hiring decisions and everything else we've seen and then get excused cause "whoops you're not supposed to use it like that, dummy." Nah.
- stavros 2y agoYour point is still trivially disproven by the fact that not even humans are expected to know all the world's trivia off the top of their heads. We can discuss whether LLMs live up to the hype, or we can discuss how to use this new tool in the best way. I'm really tired of HN insisting on discussing the former, and I don't want to take part in that. I'm happy to discuss the latter, though.
- lm28469 2y ago> Put an LLM on top of a search engine, and that's the appropriate tool for this use case. Hm nope, now that the web if flooded by LLM generated content it's game over. I can't tell how many times I almost got fooled by recipes &co which seem legit at first but are utter non sense. And now we're feeding that garbage back to where it came from
- stavros 2y agoThat's not relevant to what we're discussing, though.