4 ms·
Pulumi AI is poisoning Google search results with AI answers
- brodouevencode 3y agoI wonder how many other companies are (quietly) guilty of the same thing.
- astrodust 3y agow3schools getting bumped down to number two source of outdated, inaccurate results. Impressive.
- Larrikin 3y agoWhat are the issues with them in 2024? Like actual examples. I don't do webdev but the answers never seemed completely wrong whenever I had to look something up and I know I've read praise in recent years about how they completely revamped and the old "wrong?" Information was fixed. I know some people like to recommend other docs over them but that's not saying they're wrong or bad, just not as good.
- VHRanger 3y agoIt's not "wrong", it just has an awful signal/noise ratio.
- wccrawford 3y agoIt's really hard to fix a damaged reputation. And for a long time, the large majority of their information was horrible. It's going to take a rather long time for people to stop completely blacklisting them.
- pc86 3y agoWhy should we? If you poison the well long enough, nobody's going to drink from it regardless of whether or not you can test the water and prove that it's clean.
- UncleEntity 3y agoYeah, like sourceforge. I just googled them and the top sub-result is for "AutoClicker download" which, I assume, is intended for click fraud. Luckily "Forge Auto Clicker comes with no ads or malware making an amazing user experience!"
- astrodust 3y agoThat's just the thing. You don't know if it was fixed or not, so you really can't trust the information given. Their old PHP database material used to be utterly rife with SQL injection. Perhaps they've fixed some of that, but a single injection bug can ruin your day, so it's not something you can take as casually as they seem to.
- Repulsion9513 3y agoUsually the answers were "right" in that they worked but also wrong in that they had issues or were otherwise less-than-ideal. But I haven't used them in over a decade so lolidk
- 1123581321 3y agoI think w3schools should still be ranked highly. MDN seems better organized for people who understand how web development works and just need good reference, but there are a lot of people, possibly many more than there are skilled developers, who don't understand web development but need to make something anyway. Anecdotally, I watched someone learn front-end web development from scratch last year with a ton of googling. This person didn't understand the concepts at all (still doesn't) but w3schools seemed to help them the most to keep going and get their app made. I suggested MDN but they found it to be confusing, not even in the "I'm not ready for this yet" sense, but in the "yeah this doesn't answer the question" sense. It did answer the question and they would've been greatly helped by taking the content seriously, but they were still far from knowing what they didn't know. I have to respect that kind of user needs to use google, too.
- drcongo 3y agoYou can't poison poison.
- abyssin 3y agoGenerative AI could have a paradoxical effect of making slow, human generated content more valuable because the only alternative is free meaninglessness generated from older meaningless free content. The free, machine generated content would converge to something hypnotic and more and more addictive. The meaningful would be seen as valuable enough for people to pay. There would be no in-between.
- datadrivenangel 3y agoThis has already started to happen for manufactured goods. Mass-manufactured and cheap but low quality goods are extremely available. People also will pay a premium to some local craftsperson who makes artisanal stuff at an extremely noncompetitive price, often with less technical quality in some regard. The real need is to have trusted brands and harder to game information about those companies, so you can more quickly tell when a company starts submitting to the MBAs and eroding their quality.
- gtirloni 3y agoPeople also will pay a premium to some local craftsperson who makes artisanal stuff I won't, unless it's for the art aspect of it or to help a specific developer/artist that I want to see succeed. But by default, I'll pay a premium for high-quality very precise and reliable consumer goods that undergo strict quality assurance processes, mass produced or not. If artisanal stuff has less quality, I'm not inclided to pay a premium for it in the general case.
- dan_quixote 3y ago>I'll pay a premium for high-quality very precise and reliable consumer goods that undergo strict quality assurance processes How? Every time I find something like this, Private Equity scoops up this company and strips it for parts by the time I want to buy more.
- add-sub-mul-div 3y agoAnother side effect is a further loss of privacy if only poisoned content can be searched without being logged into a service that has your full info/credit card. GPT-(n) pollutes the freely searchable internet to shit while a subscription to GPT-(n+1) is sold as the solution.
- AbrahamParangi 3y agoThis is arguably more Google's fault than the content, obnoxious though it is. Google has been sacrificing search quality at the altar of search ads KPIs for a decade or more now and it shows.
- VHRanger 3y agoIt's totally Google's fault. The original PageRank algorithm was more resistant to low quality content - it was fundamentally about a reputation web of trust. As Google shifted from valuing high quality sources referring to you to other signals, it became more gameable. Note that the "high quality" part matters - it's harder to game getting, say, a link from real humans at a high quality place than it is to generate yet another SEO blogspam website with 10,000 backlinks from other SEO blogspam.
- nradov 3y agoLinks between sites stopped being as relevant to content quality ranking when the web became commercialized. Much of the high quality content (along with low effort junk) moved to commercial sites which mostly don't link to other sites. Or, if they do have external links it's because they're getting paid.
- pcthrowaway 3y agoThat's mainly Google's fault also, for running Adsense
- hn_throwaway_99 3y agoI agree with the other comments that Google definitely has sacrificed search quality "at the altar of ad revenue KPIs". However, I think your comments are fundamentally incorrect re "The original PageRank algorithm was more resistant to low quality content - it was fundamentally about a reputation web of trust. As Google shifted from valuing high quality sources referring to you to other signals, it became more gameable." PageRank became unusable as a primary source of quality long ago due to stuff like link farms and the like. This is a classic example of Goodhart's Law, https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law. Again, I'm not saying Google couldn't have done better by focusing more on search quality and less on ad revenue, but the idea that the "reputation web of trust" can't be totally gamed by extremely motivated spammers is just flat out false in my opinion.
- 23B1 3y agoThe miasma cometh, followed swiftly by the death of the internet as it stands. Authentication, verification, and curatorial products will be the next gold rush – and smart investors should be skating to where that puck is gonna be.
- deleted 3y ago[deleted]
- bamboozled 3y agoKeep reading about stuff like this, I don't notice it in my day to day usage of Google at the moment honestly, are other people having the same experience, does this actually matter at all? Is it affecting Google in any meaningful way?
- bearjaws 3y agoGoogle is becoming unusable for programming related questions. The telltale sign was when I have to actually put in "MDN" in the search to get MDN to show up.
- bangaroo 3y agoyou would think a company full of engineers working on web technology building a tool for finding info on the internet would understand and adjust for the fact that literally nobody on earth has ever wanted to go to w3schools, ever, at all, in the history of the entire universe.
- a_vanderbilt 3y agoLike many companies that stop innovating, it's not the engineers who are in control. "Tonerheads" are. Raghaven has Search under his thumb. Ads is putting on pressure for revenue, and their incentives are not entirely aligned with Search.
- aworks 3y agoI didn't know what "tonerheads" were. First Google search for the term gives a reddit link and enough of a summary to understand the meaning. Presumably people aren't trying to make money from that search...
- a_vanderbilt 3y agoHere's a YouTube video of a Jobs interview where the idea originated: https://www.youtube.com/watch?v=Qo8zdPNMRdY https://www.youtube.com/watch?v=Qo8zdPNMRdY
- pc86 3y agoI think there are two unrelated causes to this: 1. Marginally cleaning up low-volume technical search results is not going to get anyone promoted or a stock refresher. 2. Most of the programmers at Google are probably good enough not to have to Google programming questions. And agreed about w3schools, expert sexchange, etc.
- RedShift1 3y agoAdd "before:2023" to your search query
- zeven7 3y agoI want this idea fleshed out into a short story
- benfortuna 3y agoI'm sure an LLM can accommodate your request.
- bilalq 3y agoThis is the kind of pro tip I love seeing on HN. It's a shame that the tech field moves so fast and info gets outdated constantly, but at least for now, this helps.
- serhack_ 3y agoThere're no words for them. Manipulating SEO is equal to other scammers I've seen.
- thinkindie 3y agoI've noticed the same too. I was experimenting with Pulumi therefore I had to lookup several times on Google. At first I appreciated that their documentation is based a lot on their LLM, however I started to figure out soon that it was plagued with the same issues with other LLMs, plus it was almost everywhere and no really way to escape it. I ended up switching to Terraform because the quality of documentation was far superior.
- lxe 3y agoThe experts-exchange of the new generation
- logrot 3y ago[flagged]
- klysm 3y agoThis is 100% on Pulumi no? They had to make the intentional choice to make the AI results be indexable by search engines.
- cnunciato 3y agoPulumi engineer here. We did, as an experiment (and labeled it thusly), but we believed we’d have much more control over it than we have. After we began hearing these reports, we began taking them down. The vast majority have since been converted to return HTTP 410 with noindex directives, yet Google still hasn’t responded. It’s been frustrating for us also.
- ThinkBeat 3y agoWhat is the benefit to Google of making their product continuously worse? Is it so people will spend more time on Google and it allows Google to show more ads? and/or Does it prioritize site that Google has ads at instead of sites that matches searches.