11 ms·
Google scrambles to manually remove weird AI answers in search
- nuancebydefault 2y agoThe AI is often quoted without context. It actually answered, 'somebody has suggested adding glue...',which is different from 'add glue...'.
- bithive123 2y agoWhy do people act like LLMs only hallucinate some of the time?
- kwertyoowiyop 2y agoThe best trick the A.I. companies have pulled is getting us to refer to ‘bugs’ as ‘hallucinations.’ It sounds so much more sophisticated.
- dgellow 2y agoIt’s not a trick to sound sophisticated. Hallucinations are more like a subcategory of bugs. The system is technically correctly generating, structuring, and presenting false information as fact.
- greg_V 2y agoTechnically everything an LLM does is hallucination that happens to be on a scale between correct and non-correct. But only humans with knowledge can tell the difference, math alone can't. It's not even a bug: it's the defining feature of the technology!
- elwell 2y ago> But only humans with knowledge can tell the difference Who says the humans (all of them) aren't hallucinating too?
- astrange 2y agoKnowledge isn't sufficient to show something is false, since the knowledge can also be false. Insofar as it's important for it to be true, it needs to be continually verified as true, so that it's grounded in the real world.
- chx 2y agoAh, my friend it's not a bug It's a fundamental feature These LLMs can produce nothing else but since the bullshit they spew resembles an answer and sometimes accidentally collide with one, people tend to think it can give answers. But no. https://hachyderm.io/@inthehands/112006855076082650 https://hachyderm.io/@inthehands/112006855076082650 > You might be surprised to learn that I actually think LLMs have the potential to be not only fun but genuinely useful. “Show me some bullshit that would be typical in this context” can be a genuinely helpful question to have answered, in code and in natural language — for brainstorming, for seeing common conventions in an unfamiliar context, for having something crappy to react to. > Alas, that does not remotely resemble how people are pitching this technology.
- kwertyoowiyop 2y agoThat’s a good take. So LLMs distill human creativity as well as human knowledge, and it’s more useful when their creativity goes off the rails than when their knowledge does.
- astrange 2y agoThis is irrelevant because the LLM is mostly not answering the question directly, it's summarizing text from web results. Quoting a joke isn't a hallucination.
- dgellow 2y agoIt’s not hallucinations here, multiple of the ridiculous results can be directly traced to redit posts where people are joking or saying absurd things
- threeseed 2y agoThere are examples of hallucinations as well e.g. talking about a Google AI dataset that doesn't exist and using a CSAM dataset which it doesn't. One of the researchers from Google Deepmind specifically said it was hallucinating.
- deleted 2y ago[deleted]
- notfed 2y agoSo...every Reddit post?
- notnullorvoid 2y agoHmm yeah I kinda like the concept that it's "hallucinating" 100% of the time, and it just so happens that x% of those hallucinations accurately describe the real world.
- empath75 2y agoThat x% is far higher than people think it is because there's a tremendous amount of information about the world that ai models need to "understand" that people just kind of take for granted and don't even think about. A couple of years ago, AI's routinely got "the basics" wrong, but now so often get most things right that people don't even think it's worth commenting on that they do. In any case, human consciousness is also a hallucination.
- notnullorvoid 2y agoIt really depends on the set of prompts you present the LLM. If it's anything requiring reasoning, you'll often get nonsense that sounds like sense. It has a higher chance of being accurate with knowledge queries. LLMs are impressive, a very lossy search engine in a small package, capable of outputting convincing natural language responses.
- itronitron 2y agoit's only AI if you believe it
- kccqzy 2y agoNot hallucinations but these AI answers often (always?) provide sources they link to. It's just that the source is a random Reddit or Quora post that's obviously just trolling. Then, when people post these weird AI answers on Reddit and come up with more absurd jokes, the AI then picks it up again. For example in https://www.reddit.com/r/comedyheaven/comments/1cq4ieb/food_names_end_with_um/ https://www.reddit.com/r/comedyheaven/comments/1cq4ieb/food_... Google AI suggested applum and bananum as a response to food names ending with "um" when someone suggested uranium, Copilot AI started copied that suggestion. It's entertaining to watch.
- dazc 2y agoManually removing rogue AI results is kind of ironic isn't it?
- tflol 2y agoYou could almost argue these results are directly human generated. edit: And in that case, who is the arbiter of truth?
- rchaud 2y agoPay no attention to the Accenture contractors behind the curtain!
- JCM9 2y agoPay no attention to the army of people behind the curtain pulling levers trying to make it look like they’ve actually but a real AI.
- seydor 2y agoWe need an AI for that
- deleted 2y ago[deleted]
- nikanj 2y agoFor this tech cycle, AI is short for Actually Indians
- Barrin92 2y agogenerative AI is essentially three day labourers from an emerging economy in a trenchcoat. From data labelling, to "human reinforcement", to manually cleaning up nonsensical AI results.
- alfiedotwtf 2y agoGoogle keep making these same large and embarrassing mistakes time and time again. I think it's because their devs don't eat enough rocks every day.
- ta20240226 2y agoIs it the rocks or that the pizza that is served at Google doesn’t have enough glue?
- moomoo11 2y agoJust focus on making useful software to improve people’s lives. Holy fuck the last five years feel like such a waste.
- illusive4080 2y agoBut AI will solve everything!
- cratermoon 2y agoThrowing good money after bad. Companies spent all that money on high end GPUs for crypto mining and that went bust, now gotta figure out something to do with the hardware to try to recoup some of the investment. Google pumped $1.5 Billion into crypto.
- astrange 2y agoGoogle has TPUs.
- SoftTalker 2y agoTrained on Twitter and Reddit. Garbage in/Garbage out, as it has always been.
- threeseed 2y agoExcept that 90% of Reddit isn't garbage. It's really useful. Problem is Google can't tell what is garbage or not. No LLM can.
- SoftTalker 2y agoI'd argue it's far less than 90% but yes, there is some good information there. But weeding out the noise is what needs to happen, and (for some topics more than others) there is an awful lot of it.
- maximinus_thrax 2y ago> Except that 90% of Reddit isn't garbage. It's really useful. Citation needed. I've been a Reddit user since its inception and honestly except for niche hobby subreddits, Reddit is mostly low effort garbage, bots and rehashed content. I'd wager that mainstream subreddits are 99% garbage for training an LLM for anything other than shitposting.
- skydhash 2y agoPretty much. There were some good information, and even book worthy ones. But they were the ones that bubble to the top in helpful and knowledgeable communities. The rest is junk.
- giantrobot 2y agoEven in the niche hobby subreddits there can be a really high garbage factor. There's plenty of well meaning posters that are just wrong. They're not trying to mislead or lying they're just unaware they're wrong.
- Little_Kitty 2y ago
- CatWChainsaw 2y agoHow hard can it possibly be to just turn off the entire AI-generated overview functionality given that it just got introduced...
- YetAnotherNick 2y agoIt seems to be turned off for me. And I was in beta testing for a month. Or maybe they are figuring out who is doing weird searches and turning off for them. In any case this thing is just hilarious. Just right after their AI painted historical figures as black.
- CatWChainsaw 2y agoSo far I have not seen it ever in either Firefox or 2-3 Chromium-based browsers, on a handful of computers in multiple locations. I don't see a way google can make this work. As I understand it LLM confabulations can be reduced but never eliminated owing to how they're built. Google could try and create a fact-checking department to make queries reduced to falsehoods or bullshit but then they face the problem of appointing themselves arbiters of the "truth". The only way to win is to not play the game, as I see it. I wish the collective AI fever would break already.
- rchaud 2y agovery hard indeed, if you're optimizing for favourable opinions from Wall St analysts come earnings time .
- caesil 2y agoWho knows how many of these are fake. People have been dropping inspect-element-manipulated screenshots all over twitter. https://www.nytimes.com/2024/05/24/technology/google-ai-overview-search.html https://www.nytimes.com/2024/05/24/technology/google-ai-over... > A correction was made on May 24, 2024: An earlier version of this article referred incorrectly to a Google result from the company’s new artificial-intelligence tool AI Overview. A social media commenter claimed that a result for a search on depression suggested jumping off the Golden Gate Bridge as a remedy. That result was faked, a Google spokeswoman said, and never appeared in real results. that screenshot was tweeted by @allgarbled. ten minutes before, they tweeted: >free engagement hack right now is to just inspect element on the google search AI thing and edit it to something dumb. hurry up, this deal won’t last forever
- ethbr1 2y agoI'd say the broader issue here is a lack of transparency into results. If Google is sending bad results, who can prove that?
- realreality 2y agoThat’s always been an issue. Years ago, researchers demonstrated in an experiment that they could swing public opinion about electoral candidates by manipulating search results. Who knows if Google took that experiment and ran with it?
- ethbr1 2y agoI mean, that's always been the TikTok argument, to me. Widely-used platforms that can +/- 1% their algorithms to affect democracy have pretty high burdens of trust/transparency, and we're not close to that with any platform (Chinese or not) that I'm aware of. Meta's probably the closest, because of scrutiny, but afaik even their transparency isn't sufficient for realtime attestation.
- deleted 2y ago[deleted]
- 2y ago
- pilooch 2y agoSo Google hasn't used an LLM to generate and test weird queries ? This is not putting the bar very high for the whole industry... There'd be so much to gain from a clean deployment... Either it hard, either it is a rush. As a machine learnist, I believe it's actually impossible, by design of the autoregressive LLM. This race may we'll be partially to the bottom.
- CaptainOfCoit 2y ago> So Google hasn't used an LLM to generate and test weird queries ? What about simple manual testing? Seems to have skipped QA completely, automated or not.
- pilooch 2y agoThe adversarial surface to the LLM remains enormous, manual cannot handle it.
- jameshart 2y agoAsking how to prevent cheese from sliding off pizza is not an adversarial prompt.
- nicklecompte 2y agoThere has been a lot of excitement recently about how using lower precision floats only slightly degrades LLM performance. I am wondering if Google took those results at face value to offer a low-cost mass-use transformer LLM, but didn’t test it since according to the benchmarks (lol) the lower precision shouldn’t matter very much. But there is a more general problem: Big Tech is high on their own supply when it comes to LLMs, and AI generally. Microsoft and Google didn’t fact-check their AI even in high-profile public demos; that strongly suggests they sincerely believed it could answer “simple” factual questions with high reliability. Another example: I don’t think Sundar Pichai was lying when he said Gemini taught itself Sanskrit, I think he was given bad info and didn’t question it because motivated reasoning gives him no incentive to be skeptical.
- JCM9 2y agoThe fall of Google’s reputation on ML is nothing short of spectacular. They went from having a near untouchable reputation as being far ahead of any other large tech company on ML to total shambles in a year. Everything they’ve released has been a complete popcorn worthy dumpster fire from faked demos, to racist models that try and pretend white people don’t exist, to this latest nonsense telling me put glue on my pizza. What the heck happened? Or was their reputation always just more hype than substance?
- rvnx 2y agoIt could be because they actually released something. If you look back, the Google Research blog posts always have grandiose claims, but you can often never use them.
- seydor 2y agoIt's not really that bad. I use gemini often and it's great. I prefer their UI
- jerf 2y ago"Achieving the initial 80 percent is relatively straightforward since it involves approximating a large amount of human data, Marcus said, but the final 20 percent is extremely challenging. In fact, Marcus thinks that last 20 percent might be the hardest thing of all." 100% completely accurate is super-AI-complete. No human can meet that goal either. No, not even you, dear person reading this. You are wrong about some basic things too. It'll vary from person to person what those are, but it is guaranteed there's something. So 100% accurate can't be the goal. Obviously the goal is to get the responses to be less obviously stupid. Which, while there are cynical money-oriented business reasons for, it is obviously also a legitimate hole in the I in AI to propose putting glue on pizza to hold the cheese on. But given my prior observations that LLMs are the current reigning world-class champions at producing good sounding text that seems to slip right past all our system 1 thinking [1], it may not be a great thing to remove the obviously stupid answers. They perform a salutatory task of educating the public about the limitations and giving them memorable hooks to remember not to trust these things. Removing them and only them could be a net negative in a way. [1]: https://thedecisionlab.com/reference-guide/philosophy/system-1-and-system-2-thinking https://thedecisionlab.com/reference-guide/philosophy/system...
- SoftTalker 2y ago> putting glue on pizza to hold the cheese on It's actually not the dumbest idea I've heard from a real person. So no surprise it might be suggested by an AI that was trained on data from real people.
- krapp 2y agoIt wasn't an idea, though. It was a joke someone made on Reddit. If an AI can't tell the difference, it shouldn't be responsible for posting answers as authoritative.
- dgellow 2y agoInsane people at Google thought it would be a good idea to let Reddit of all places drive their AI search responses
- JCM9 2y ago“manually remove weird AI answers” is an oxymoron. Sort of like saying “deployed manual drivers to improve self driving performance”
- thesimp 2y agoI'm actually shocked that a company that has spent 25 years on finetuning search results for any random question people ask in the searchbox does not have a good, clean, dataset to train an LLM on. Maybe this is the time to get out the old Encyclopedia Britannica CD and use that for training input.
- SoftTalker 2y agoI am also surprised that training data are not much more curated. Encyclopedias, textbooks, reputable journals, newspapers and magazines make sense. But to throw in social media? Reddit? Seems insane.
- sgift 2y agoEven some results from "The Onion" seem to be in it. Looks like Google just took every website they've ever crawled as source.
- helsinkiandrew 2y agoThe problem is that for some searches and answers Reddit or other social media is fine.
- dgellow 2y agoBut only if you do a lot of filtering when going through responses. It’s kind of simple to do as a human, we see a ridiculous joke answer or obvious astroturfing and move on, but Reddit is like >99% noise, with people upvoting obviously wrong answer because it’s funny, lots of bot content, constant astroturfing attempts.
- morkalork 2y agoThe users of r/montreal are so sick of lazy tourists constantly asking the same dumb "what's the best XYZ" questions without doing a basic search fit, the meme answer is always "bain colonial" which is a men-only spa for cruising. Often the topmost voted comment. I just tried asking gemini and chatgpt what that response meant and neither caught on..
- cdme 2y agoIt’s pre-alpha trash that’s worse than traditional search in every meaningful way. Kudos to the artist at the Verge for the accompanying image — those are fingers AI would be proud of.
- OutOfHere 2y agoWith these dangerous answers, to the general public, Google is giving AI a very bad name, when in truth it's strictly Google that deserves the feeling.
- TrianguloY 2y agoPutting glue on the pizza is (apparently) a clever way to take pictures of slices of pizza that look "perfect" to the camera (not for eating, obviously) [1]. I remember a couple years ago some videos of "tricks" showing this, plus literally screwing the pizza with screws. So, yeah, the ai did in fact autocompleted the question correctly. It was just the wrong context. Good luck trying to "fix" that. [1] https://shotkit.com/food-photography-secrets-revealed/ https://shotkit.com/food-photography-secrets-revealed/ (number 2)
- namaria 2y ago"correctly but wrong" is just wrong.... there are no points scored for "in a very specific context it would've made sense"
- billyjmc 2y agoThis is the kind of ridiculous fumble that GOFAI (like Cyc) should be able to avoid by recognizing context. I wonder how neuro-symbolic systems are coming along, and whether they can save us from this madness. The general populace wants the kinds of things LLMs provide, but isn’t prepared to be as skeptical as is needed when reviewing the answers it generates.
- PreInternet01 2y agoIt's debatable whether Google has truly lost the plot because of the "AI wars", but the moment the statement "Bing returns more sensible results than you" becomes verifiably true, it's... cause for concern? The approach that Google appears to have taken, which is to assume that the top-ranked part of its current search index is a sensible knowledge base, may have been true some years ago, but definitely isn't now: for whatever reasons, it's now 33% spam, 33% clickbait/propaganda, with the rest being equally divided between what could be called "truths" and miscellaneous detritus. To me, it seems that returning to the concept that search results should at least reflect a broad consensus of what is true is a necessary first step for Google. As part of that, learning to flag obvious trolling, clickbait and bad-faith content is paramount. And then, maybe then, they can start touting their LLM benefits. But until the realities of the Internet are taken into account (i.e.: it's 80% spam!), any "we offer automated answers!" play is doomed.
- greg_V 2y agoOh it gets even better. The public has been hearing about AI this and AI that for over a year, but the existing use cases and deployment was confined to some super special niches like writing or the creative industries and programming. This is the first nation-scale deployment of the technology, running on Google's biggest and most profitable market in one of the most widely used internet services, and it's a shitshow. They can try manually fine tuning it, but all of the investors who have been throwing money at AI for the past year are now learning what this tech is like in the day-to-day, beyond just speculations, and it's looking... bad.
- PreInternet01 2y agoYeah, the most likely take here is that Google's leadership truly did not recognize how utterly awful the quality of their flagship search index had become over the years. I mean, it explains a lot, but still... you're recruited using industry-leading practices out of an overflowing pool of abundant talent... and this is what you make of it? As the kids say: SMH!
- 2y ago
- deleted 2y ago[deleted]
- geuis 2y agoHey Google. Here's a really stupid idea. Knock it off. Your core search result product has gotten increasingly worse and less reliable over at least the last 5 years. YouTube's search results are nearly unusable. I can't imagine almost any external customer is asking for the AI bullshit thing that's just being shovelwared into everything Alphabet product now. I just noticed a couple days ago the gmail iOS app now does the same predictive completion that Copilot tries to do when I'm working. It's annoying as hell and I can't find how or if I can turn it off. Stop bullshitting around with ruining your products and get back to making money by making accessing information easier and more accurate.
- izacus 2y agoGoogle: Hey geuis, our revenue is record, our stock value is record, our metrics are all at record. The execs making decisions have just paid of millions in stock [1] making them staggeringly rich no matter what happens in the future. We can't hear your over the sound of green bills going BRRRRR. [1]: https://www.businessinsider.com/alphabet-google-executive-pay-cfo-president-200-performance-stock-payout-2024-5 https://www.businessinsider.com/alphabet-google-executive-pa...
- internet101010 2y agoMost accurate description of Google I have seen. YT search is so, so bad. Three relevant results followed by twelve "people also watched" results then back to the good results.
- fma 2y agoAlthough ChatGPT is a great product, I rely on it more and more not because it's improving, but because Google results are getting worse. Yeah I would still fact check for complex, indepth things...but for quick things where I'm knowledgeable enough I can smell the hallucinations from a mile away, ChatGPT 100%.
- deleted 2y ago[deleted]
- freitzkriesler2 2y agoI'm waiting for some clever hacker to come up some sort of logic bomb that causes the learning sets to become worthless. Something innocuous to a non ai scientist human but is otherwise fatal to the LLM data sets.
- deleted 2y ago[deleted]
- astrange 2y agoIt's just text. You cant make some text that's magically dangerous.
- freitzkriesler2 2y ago"text" made the LLMs report offensive and give unfiltered replies to inqiiries. To think what I said above can't happen during the web scraping process is naive. Thanks for the down d00t.
- mensetmanusman 2y agoI have already eaten rocks and glue, the AI had won.
- odyssey7 2y agoThis is analogous to the Apple Maps launch failure. Except that Apple competes to make the best smartphone, and an iPhone was still valuable without Apple Maps. What happens to Google if it stops being able to compete in search?
- kibwen 2y ago"Search" isn't Google's product. Google hasn't been a search company for 20 years. "Ads" is Google's product. And the only way they'll go bankrupt is if 1) companies realize that advertising is pointless (I'm not holding my breath), or 2) some other company takes over from Google, which seems unlikely without government intervention (I'm not holding my breath). Google is a shit company, but they'll still be around 20 years from now, because our economy is nonsensical and irrational.
- tedunangst 2y agoStill need visitors to see the ads.
- coldcode 2y agoI think it's a good use for AI. AI's making ads that AI's watch to enrich Google execs. Who needs people?
- giantrobot 2y agoGoogle runs ads for a significant percentage of the web (or the markets for ads). Even if everyone stopped going to google.com tomorrow they'd still be seeing ads that make Google money. Google the company would still be tracking much of the web's traffic feeding it into their ads platform.
- astrange 2y agoInteresting thing about that is that Bing Maps was worse at the time, has never gotten better, and nobody noticed because nobody cares about it.
- chx 2y agoGoogle had the best search engine there is. Then they enshittified it for short term profit and now they panic instead of reverting course and simply laugh at AI companies. Madness.
- JSDevOps 2y agoThe cat is out of the bag. Keep eating rocks and sticking down your pizza toppings.
- nialv7 2y agoI am not surprised that AI results are bad. I know they are bad. But that doesn't concern me because I expect it to get better. What concerns me is that Google would push this trash to the front page. What are they even thinking? Who gave go ahead on this?
- ben_jones 2y agoInstitutional investors panic > board panics > executives panic > evps panic and dictates incentives to ship AI > directors, ems, and below, who actually know how shit works, take a submissive role because they have mortgages in Mountain View to pay. That’s how it happens.
- astrange 2y agoNot sure if anyone below director can afford a mortgage in Mountain View.
- fragmede 2y agoI know that's hyperbole, but here's something for $600k. Let's say it goes for $700k. 20% of 700 is $140k. An L4 engineer at Google makes like $300k. round down to $200k post tax. live in shared housing for $2000/month; that's $24k/yr, add $2000/month living expenses on top of that, is another $24k. Stick $2000/month into 401k, Save the rest (200-24-24-24 ) 128k and you'll save up $140k in a bit over a year. bam; owner, not renter. Now, whether this is better than renting, and putting the money into the stock market is totally other question, but even L4's at Google can afford a mortgage in Mountain View. https://www.zillow.com/homedetails/50-E-Middlefield-Rd-APT-40-Mountain-View-CA-94043/19517548_zpid/ https://www.zillow.com/homedetails/50-E-Middlefield-Rd-APT-4...
- deleted 2y ago[deleted]
- more_corn 2y agoMaybe they could create a function that identifies satire. Which seems obvious after about five seconds of consideration.
- causality0 2y agoIt's very funny that Bing AI is now also telling people to eat a small rock every day, and citing pages telling people about how dumb Google AI is for telling people to eat rocks.
- internet101010 2y agoThey should start with just removing reddit from the data set.
- notfed 2y agoNow the AI changed from an immature teenager to a blogspam article
- r053bud 2y agoI’m curious why Sundar Pichai is still running this company? From recent videos it really seems like he has no idea what he’s talking about, and the company seems to be headed in the wrong direction. Just checked the 5 year stock graph; now I understand
- Freak_NL 2y agoWhy? I wouldn't mind using a search engine where Weird Al answers my queries.
- lupire 2y agoGary Marcus, an AI expert and an emeritus professor of neural science at New York University, thinks the 80/20 rule (or 90/90 rule) is true.
- water-your-self 2y agoMost of the search results fixes are manual and are in response to publicity. You can typically find analagous problems for weeks/ quarters after things like this.
- bitwize 2y agoGoogle hooked Joe up to the tank and is just now realizing what they'd done and scrambling to contain the damage. With the Department of Justice breathing down their necks it's a doubly bad look for them. I'm not crying any tears for them though.
- empath75 2y agoI love chatgpt and use it all the time and find it tremendously useful, but I never want to see AI generated content when I am not specifically looking for it. I don't want to see it in comments, I don't want to see it in search results, I don't want to see it as an illustration for an article, I _really_ don't want to see AI generated word vomit blog posts or fake "news" articles when I'm looking for actual information. It's not even because it's sometimes (or often) wrong or full of hallucinations. Even if it's 100% factually correct all of the time, it's _poor quality writing and art_, full of cliches and bland generalities, which even if they solve all the rest of the problems it's sort of fundamental to the architecture of transformers. You can't ever be truly creative or unique if you're predicting the _most likely_ token.
- mvkel 2y ago1. Google announces something that has AI bolted on 2. A VP pontificates about how much work they did to "get it right" 3. An easy-to-anticipate first-order issue surfaces 4. Sundar issues a statement like "this is completely unacceptable. We will be making structural changes to ensure this never happens again."[0] 5. GOTO 1 [0] https://m.economictimes.com/tech/technology/sundar-pichai-calls-geminis-controversial-responses-completely-unacceptable-report/articleshow/108066199.cms https://m.economictimes.com/tech/technology/sundar-pichai-ca...
- kevinventullo 2y agoThis is what happens when senior leadership no longer even attempt to hide their contempt for the rank-and-file.
- ttGpN5Nde3pK 2y agoMy whole qualm with this AI integration into search engines: it's a search engine, not a question engine. I go to google to search the internet for something, not ask it a question. IMO, asking AI for something is a different task than searching the internet. It's sorta the same problem as if I go into a store and ask an employee where something is, and they reply with "well what are you trying to do?"
- PillCosby 2y agoLike the overly helpful person at the local hardware store.
- rufus_foreman 2y agoWhat hardware store have you gone to where this was an issue for you?
- bombela 2y agoI sometimes wants a search engine, sometimes a question engine. Likewise at the store. Why not have both with a way to choose which one I want on the moment?
- skydhash 2y ago> I sometimes wants a search engine, sometimes a question engine. If you want a search engine, it's easy to use the results as a feedback to refine the query. But a question (answer?) engine would need to be an expert in the subject. And not parroting stuff. That usually means curation. You need something to do the work ahead to filter the wheat from the shaft. I don't see how LLMs can do that. LLMs can't be a search engine, and can't be an question engine. The best way to treat it is a simulation engine, but the use cases depend on the training data. But the proof is there that the internet is full of junk, and not that expansive.
- fragmede 2y ago> I don't see how LLMs can do that. If it's in the training data, then it should be able to do that. That is to say, a comment's points matter. and the subreddit it's on. and who said it, and how the rest of their comments do/where they are. The LLM could annotate the unredacted reddit dataset with metadata as to where to rate it on the words used, the accuracy of the information, the sarcasm quotient, the hilarity quotient, how condescending the comment is; all of that an LLM could generate metadata about and feed into itself to get better and better.
- zogrodea 2y agoThis approach to remove bad search suggestions manually reminded of a different approach Google once took, where they weren’t satisfied with manually tweaking search results but rather wanted to tweak the algorithm that produces these results when there were bad results. 'Around 2002, a team was testing a subset of search limited to products, called Froogle. But one problem was so glaring that the team wasn't comfortable releasing Froogle: when the query "running shoes" was typed in, the top result was a garden gnome sculpture that happened to be wearing sneakers. Every day engineers would try to tweak the algorithm so that it would be able to distinguish between lawn art and footwear, but the gnome kept its top position. One day, seemingly miraculously, the gnome disappeared from the results. At a meeting, no one on the team claimed credit. Then an engineer arrived late, holding an elf with running shoes. He had bought the one-of-a kind product from the vendor, and since it was no longer for sale, it was no longer in the index. "The algorithm was now returning the right results," says a Google engineer. "We didn't cheat, we didn't change anything, and we launched."' https://news.ycombinator.com/item?id=14009245 https://news.ycombinator.com/item?id=14009245
- dpflan 2y agoWow. Thank you for digging this up!
- badgersnake 2y agoSounds rather like how Google photos does not identify anything as a Gorilla.
- avar 2y agoIt sounds like the exact opposite of that story. They manually blacklisted gorillas from being identified because they kept conflating black people with gorillas.
- kreyenborgi 2y agoGoogle bought all the gorillas?
- deleted 2y ago
- deleted 2y ago[deleted]
- mvdtnz 2y agoYour usual reminder that there was a guy at Google who was so impressed by their LLM that he considered it sentient. And this was two years ago when the AI was presumably far less developed than the current abonination. https://www.theguardian.com/technology/2022/jun/12/google-engineer-ai-bot-sentient-blake-lemoine https://www.theguardian.com/technology/2022/jun/12/google-en...
- astrange 2y ago> And this was two years ago when the AI was presumably far less developed than the current abonination. It's gotten worse since then because the development effort has been on making it faster and cheaper. If you use Gemini it's quite good, especially the paid one.
- Animats 2y agoAs I mentioned previously, I've seen Bing's LLM stall for about a minute when asked something iffy but uncommon. I wonder if Bing is outsourcing questionable LLM results to humans. Anyone else seeing this?
- rezonant 2y agoIt could be that, but it also could be a cascade of non-LLM checks and retries to GPT with additional prompting.
- thenewwazoo 2y agoPerhaps they could run each search result through ChatGPT. It's pretty skilled at spotting bad results. For example, I asked it whether the glue-on-pizza result was "valuable and should be shown to a user" and it returned "No, this response should not be shown to the user. The suggestion to add non-toxic glue to the sauce is inappropriate and potentially harmful."
- mikewarot 2y agoMy initial thought was to simply have any match with an Onion story blacklisted... But then I realized that The Onion became prophetic in 2016 when Trump ran for president. Since then the only difference between an Onion fiction and things actually sucking that much is a decade or less in almost all cases. If we blacklisted content seen in the Onion, we'd automatically wipe out most news.
- is_true 2y agothe problem google have is that the ai answers are based on results and results got really bad a few years ago. I got a couple of answers that are based on SEO spam produced by an ecommerce with a lot of reputation and of course the answers don't make any sense
- jzemeocala 2y agoI had to do a double take as I thought it was about Weird Al Yankovich for a second
- aa_is_op 2y agoIt's a whackamole game. They should have never bothered with AI in the first place
- asdf6969 2y agoThey will fix this by lobbying to make saying false things on the internet illegal.
- Tiktaalik 2y agoFeels like there's a market for a bunch of Googlers to go off and take what they know about how Google works and make a new, barebones search engine that is essentially Google circa 2015. Before AI, before we had to append "reddit" to get useful human knowledge.
- hulitu 2y ago> Google scrambles to manually remove weird AI answers in search Maybe they shall check what AI is, in the first place. They didn't seem to get the basics.
- seanp2k2 2y agoHow are any investors cool with the ROI of AI in 2024?
- childofzombie 2y agoWhat's wrong with Weird Al's answers?
- Havoc 2y agoAm I right in thinking this means they are using RAG to inject this rather than directly training the model on the source?
- LoveMortuus 2y agoI switched to MS Edge on my Android a couple of years ago and at that time I didn't notice that the default search engine was Bing... Now I do.
- piloto_ciego 2y agoI don’t understand why these companies done just talk to people like they’re actually people and tell people when they’re rolling out new stuff. Straight up, and this going to sound really stupid I know, but if Sundar Pichai had just come out and said, “hey, we’re trying to do this new thing, it’s gonna be hard but we want to make Google awesome if you like the results click ‘I like it’ button, otherwise click the ‘dislike’ button so we can get some real feedback from people, but seriously, this stuff is hard, so please help us out. If we can tune the AI so that we can give you the best results possible it will make Google way better! Also, if you don’t wanna see any of this, there’s a setting here to turn it off.” Just ask people, show a little humanity, and act human and you’ll get better results and won’t be getting all this pad press. The same thing for openAI right now too. Seriously, though, does anybody else crave authenticity? These companies are all acting like the AI that they’re trying to create, but from five years ago when it was shitty and didn’t know how to communicate with people. Just talk to people and ask for their help. Just being honest and talking to people normally isn’t that hard.