6 ms·
I've been gone from G for 4 1/2 years now. When I was there, the weekly meetings often featured "search quality" measurements that were rigorous in their object
by AlbertCory 5y ago
I've been gone from G for 4 1/2 years now. When I was there, the weekly meetings often featured "search quality" measurements that were rigorous in their objectivity (I thought). They bent over backwards to be non-self-deluding.
I distinctly remember Udi Manber saying "if the web is slow, it's our fault" (actually, the speech was that everything is "our fault"), meaning, really, "take responsibility for problems and don't throw up your hands."
However, the natural tendency of any organization is to reward the suckups and promote mediocre people who just get along with everyone. It wouldn't surprise me if that's what's happened with Google, too.
- whakim 5y agoIt seems weird to me that Google would take "search quality" seriously for 15+ years (including nearly a decade as one of the biggest companies in the world) and then suddenly stop. Are you able to share any of those objective measures of quality? Because it seems to me that most of the discussions around the declining quality of Google search amount to anecdata backed up by reasoning that doesn't really make a lot of sense to me (e.g., "Google only cares about short-term revenue!")
- fdgsdfogijq 5y agoCould just be that sundar pichai wants a bigger paycheck and tunes the knob on more ads money but less good search results
- whakim 5y agoTo me, it seems crazy that a company would actively try to self-sabotage their bread-and-butter product in search of a bit of extra revenue when they're already making record profits. Not to mention that, as the author of the article points out, Google published a well-known quantitative paper on why that's a bad tradeoff.
- fdgsdfogijq 5y agoIt happens all the time though. Look at amazon, they flood their marketplace with cheap knockoff products that hurt the credibility of their ecommerce offerings, but the money generated is too much to shut off. So in the short run, amazon makes more money for a worse reputation, and in the long run ??? its unclear
- whakim 5y agoI don't think that's analogous: you'd have to argue that Amazon spent a ton of time and effort on keeping cheap knockoff products off their marketplace and then did a sudden u-turn and decided not to do that anymore. Even then, I don't think the analogy holds, because the quality of Amazon's marketplace listings isn't anywhere near as synonymous with Amazon as the quality of Google's search results is with Google.
- bryanrasmussen 5y ago>Even then, I don't think the analogy holds, because the quality of Amazon's marketplace listings isn't anywhere near as synonymous with Amazon as the quality of Google's search results is with Google. What? Why not, and anyway Amazon I'm giving money. I'd think that quality there would be more deeply linked than anywhere I'm just giving some time.
- prewett 5y agoMy dad frequently says that sooner or later the finance guys get in charge of the company and then they cut the fat and keep cutting into the product. Sooner or later they go too far. Seems fairly inevitable, seems to happen a lot. I assume that what happens is that the product matures, so the obvious thing to do is make things more financially efficient. Problem is, the company sells a product and the finance CEO's core competency is reducing costs, and reducing costs isn't something that customers actually buy.
- danielrpa 5y agoThe CEO and upper management might simply not care about the long-term viability of the company. Cashing out in the short-term sounds more like what these executives generally do.
- JimDabell 5y ago> It seems weird to me that Google would take "search quality" seriously for 15+ years (including nearly a decade as one of the biggest companies in the world) and then suddenly stop. Is anybody claiming that it’s sudden? Everybody I’ve seen complain about Google search results has seemed to think that it’s been getting slowly worse over a long period of time.
- ffhhj 5y agoIt seems Google started decaying when they gave up their social platform G+ Nowadays all those tweaks to the algorithms, specially search and gmail spam filters, are like a desperate attempt to make the ship move faster by removing parts of the hull while keeping the water out. It will just sink at some point.
- Gigachad 5y agoI don’t think google search has gotten worse, I think the SEO abusers have just started winning. So much content on the web is automatically generated and made to look just like real hand crafted content. So much of it has titles and headings which have little relation to the search. I was recently searching for a piece of ceramic cookware, specifically looking to avoid non stick coatings. And google search showed me lots of listings with my exact search terms, but when I click the page it shows their generic product range which has nothing to do with ceramic despite the title saying so.
- bryanrasmussen 5y ago>I don’t think google search has gotten worse, I think the SEO abusers have just started winning. So much content on the web is automatically generated and made to look just like real hand crafted content. So much of it has titles and headings which have little relation to the search. right, I mean we have nearly daily posts here about almost human level quality texts you can generate with various machine learning solutions. Add to that sites who serve users needs must focus on doing that, the sites that just game Google search rankings can focus on that.
- 5y ago
- echen 5y agoYeah, when I was at Google, the SERP (and caring about users) was a shrine at all levels. Here's an example of one of the weekly Search meetings AlbertCory is talking about: https://search.googleblog.com/2012/03/video-search-quality-meeting-uncut.html https://search.googleblog.com/2012/03/video-search-quality-m... For example, my first week at Google/YouTube, I was in a New Hire meeting with our VP. Someone asked about profitability, and he responded that Larry said we didn't have to worry about revenue yet, since the main goal was user growth/happiness, and revenue could come later. Which I thought was fascinating, considering how big YouTube already was at the time (in 2013)! Though I think this changed a year later, and I find YouTube ads a poor experience compared to Instagram and TikTok -- which aren't merely "better than the rest", but stuff I actually enjoy watching.
- odessacubbage 5y agoin 10+ years of targeted advertising, i still have yet to see a single ad for something that is actually relevant to what i want to buy. i'm actually baffled that these companies that have my entire purchasing history and metadata still cannot do a better job at making me spend money than absolute randos on the internet.
- londons_explore 5y agoIndeed - it really surprised me that we didn't see big ad companies saying:. "we've crunched all the data about you, and here is a list of the products you'll be wanting to buy this week. Buy them all? [Yes] [No]". The company should be smart enough to know I only buy certain brands of dog food. It should know I need a gift for my mum (and what she likes). It knows I need new trainers but will only buy the cheapest. Etc. The opportunity for this has pretty much closed with the era of data privacy coming in, but I think it is both surprising and a shame that this didn't happen in the last decade.
- thow-58d4e8b 5y agoThis is a fundamental issue with the ad business - the ads are selected from those who bid, not from those that are relevant. For example - if I'm listening to a podcast with a captivating guest, the relevant links would point to their books or blogs. But since they didn't bid for ads, I'm shown some crypto drivel or date-Thai girls scams
- fnord77 5y agojust an anecdote, but I see quite a few people in my linked in network who are now at google within the last few years. People I wouldn't consider "google quality".
- literallyaduck 5y agoGo to image search and type in "white people" without quotes. Now repeat the search but with "black people" without quotes. Try the same for "white couple" without quotes. Try the same for "black couple" without quotes. Do you have any insight to this phenomenon?
- exikyut 5y ago"Do what I mean not what I say" becomes Very Interesting™ when politics are involved!
- the_only_law 5y agoNot completely sure what this “phenomenon”. There’s a few things I can imagine you are insinuating but they all had simple explanations so I’m not sure. Don’t disagree with the main theory that search quality is deteriorating. I have to use increasingly contrived queries to get anything but bullshit blog spam, and indexing seems really odd at times.
- fdgsdfogijq 5y ago
- meowtimemania 5y agoI just did the 4 searches you suggested but didn’t see anything note worthy. What did I miss?
- the_only_law 5y agoNothing that can’t be easily explained, of course, anyone coming with a reasonable explanation is being downvoted by the “critical thinkers” of HN who can only instead provide low effort quips.
- elcamino44 5y agoBut if you just search for “person” or “couple” you get results showing mostly white people and couples. I don’t think what you’ve observed is saying what you think it is…
- foobiekr 5y agoBut slow/fast isn't quality. What were the rigorous measurements? Latency of results to click? User clicked above the fold? I have wondered about this now for several years, because from my point of view Google search has steadily degraded since around 2010. The specific degradation isn't that it returns nothing, or irrelevant pages, but that it returns mostly _recent_ content, and returns very little _older_ content which is still assuredly on the web. I can see how Google's approach will work for the average search query - after all, the average query is probably about something happening now - but that doesn't equate to _quality_.
- marginalia_nu 5y ago> But slow/fast isn't quality. What were the rigorous measurements? Latency of results to click? User clicked above the fold? Slow and fast is what we experience. We live in a phenomenological world, not a world of millisecond metrics. While it isn't rigorous, for humans, numbers are pointless. We can't experience them. What matters is whether it feels fast.
- foobiekr 5y agoThat isn’t quality. That’s like saying a crappy textbook full of errors that ships prime same day is better than a good textbook that takes a week to arrive.
- marginalia_nu 5y agoSure it is, what it isn't is quantity. Quality and quantity isn't the same thing.
- deleted 5y ago[deleted]
- bhawks 5y agoI think just attributing this to the right people not being in charge over simplifies the problem. Search is a complexity beast and simply continued to grow in complexity during the several years I worked directly on it. Folks were proud of the fact no one could even enumerate all the features in the system (attempts were made and abandoned). The tools to change search safely werent keeping up with the complexity of the system. Understanding impact with evals and experiments became much harder. Gwsdiff and friends grew flakier. Debugging had so many different entry points depending on what you needed to do. The search stack deserves some really deep cleanups and refactoring, the eval and devtools are similarly in need of a ton of love.
- foxfluff 5y ago> the weekly meetings often featured "search quality" measurements that were rigorous in their objectivity (I thought). I wish this part got discussed, but every time I've attempted it, the discussion has been shut down by "lol they're experts at search and you're not and you don't know what they know." I wouldn't put it past Google to be blindsided thinking their own metrics are objective (perhaps they are objective measurements of something but not of what they actually want to measure). If anything, the battle with SEO just shows how hard it is to do something right and avoid getting gamed. If they can't rank SEO spam off the front page, why would I believe their measurements are any better than the rankings? There's also always a small possibility that metrics are worse than wrong; they could actually say everything is fine, keep serving these long form SEO spam articles that people click and read for far too long before realizing it doesn't have have the answers they seek.