4 ms·
“the Google executive Jerry Dischler said this was not a “hallucination” – where AI systems invent untrue information – but rather a reflection of the fact the
by firecall 2y ago
“the Google executive Jerry Dischler said this was not a “hallucination” – where AI systems invent untrue information – but rather a reflection of the fact the untrue information is contained in the websites that Gemini scrapes.”
So what you are saying is that Gemini is basically useless?
Good to know. Thanks for clarifying that Google!
- BugsJustFindMe 2y agoAI search as yet lacks necessary incredulity.
- manuelmoreale 2y ago“I did not invented some bullshit, I just repeated the bullshit someone else has invented” doesn’t really sound like a great argument.
- switch007 2y agoDon't worry, just ask it to cite its sources so you can verify
- jrootabega 2y agoNo, they're saying that Google searching in general is often useless.
- g-b-r 2y agoChecking your web search sources and credibility is a lot easier
- UncleMeat 2y agoIf I do a google search I can inspect the source of a response for trustworthiness and I can inspect several other sources that also appear in the results for agreement. With an AI query I get one response back and although people are trying to teach their AI tools to cite sources, this is not universal.
- crazygringo 2y agoThat's quite a leap there from "sometimes wrong" to "basically useless"...
- WhyNotHugo 2y agoIf a model often produces information that is blatantly wrong, then you need to check ALL of its outputs. If you're going to have to double-check all information that it provides, you might as well skip using it entirely and search for the information directly.
- nolist_policy 2y agoLLMs produce wrong results. News at 11.
- crazygringo 2y agoYou're missing the part where searching for the information directly might take hours or even days. You're looking for black-and-white truth, while the real world is actually more interested in efficiency. I can spend 2 days scouring documentation and forum posts and experimenting to get ffmpeg or Matplotlib to produce exactly the results I want. Or I can just ask ChatGPT and check if its code works, and if it doesn't maybe spend 10 minutes correcting it so it does, or refining the prompt so it does. And so you're also missing the part where verifying the correctness of output is very often many orders of magnitude faster than coming up with the output in the first place.
- rdtsc 2y ago> quite a leap there A healthy hop I would say, keeping in mind that this was showing off the best side of it in a commercial. So it just did a Google search, got a wrong factual result, the LLM couldn’t verify it was bogus, regurgitated it as is, and the executive piped in with “acshually, it’s just a plain old search result” somehow not realizing that just makes them look even worse.
- loveparade 2y agoTo be fair, do you believe a human would do better? If you hired someone to create content for your cheese website they would probably do the same thing. They'd search google and copy statistics without triple-checking all of them. I don't think it's fair to frame this is an AI issue. The internet is simply full of misinformation. Should AI outperform the average human and detect misinformation? Maybe. But I don't think that's part of the current value prop, at least not for "non-reasoning" models. If you use an LLM you should be aware that what you're getting is whatever is most commonly found on the web. If that's not what you want, don't use an LLM.
- stefan_ 2y agoAmazing, they got the "actually" guy for a PR person. That's still shit Jerry!
- Rebelgecko 2y agoFor better or worse Jerry isn't a PR person
- frenchtoast8 2y agoNot just the "50 to 60 percent" statistic, it looks like the entire paragraph in the ad is word for word identical to a preexisting cheese shop site. So either Gemini's "generation" is just searching the web and doing verbatim copy paste, or Google copied it themselves which would be a new low for Google.
- coliveira 2y agoA lot of the answers given by Gemini are just a verbatim copy of parts of web sites. I have seen this time after time when comparing the AI results and text that I find in the referenced web sites.
- palmotea 2y ago> it looks like the entire paragraph in the ad is word for word identical to a preexisting cheese shop site The cheese shop should sue Google for copyright infringement. That's also blatant plagiarism, and Google should get an F for the course.
- ssharp 2y ago> “the Google executive Jerry Dischler said this was not a “hallucination” – where AI systems invent untrue information – but rather a reflection of the fact the untrue information is contained in the websites that Gemini scrapes.” This is a huge fail for Gemini. Google, of all companies, should know the incentives to distort information aggregators for monetary gain (just look at how bad search results are these days). It's 100% expected that people will try to game LLMs the same way. It's entirely dependent on the LLMs to counteract this.
- drawkward 2y agoMaybe the goal is not accuracy, but market capture?
- coliveira 2y agoBingo. They admitted what everyone suspected: they are just scrapping BS from BS websites and spilling it back as something created by an "intelligent agent".
- tonetheman 2y ago[dead]
- qwertox 2y ago> but rather a reflection of the fact the untrue information is contained in the websites that Gemini scrapes It was a verbatim copy of the text, which raises the question about copyright. I guess "Wisconsin Cheese Mart" could probably sue Google, but more importantly, this would also mean that it is capable of making verbatim copies of the books contained in Anna's Archive. That is, assuming that Google also did torrent the books like Meta did, which is very likely. Funny how they call it "reflection", and not "copy". Maybe that's the way to win in courts: I didn't copy that movie, that was just a reflection of it. Wouldn't this user of Gemini, who would copy Gemini's response to use this text in their ads, potentially get into copyright troubles with "Wisconsin Cheese Mart"?