5 ms·
Ironically, my work on my own search engine has led me to be a bit more patient with Google's problems. At least I think I understand them better. Search engine
by marginalia_nu 5y ago
Ironically, my work on my own search engine has led me to be a bit more patient with Google's problems. At least I think I understand them better. Search engines fail in weird ways.
I think in part that Google just has gotten a spectacularly confusing failure mode. If it can't find good matching contents, it starts second-guessing your query and producing other results, which makes you think it's not even considering what you entered. It may even be "better" in the sense that it's more likely to return at least something relevant, but in practice it's bad UX because it's so unintuitive what's happening. It's probably one of those unfortunate optimizations that are invisible when they work and frustrating when they don't.
There is so much stuff on the Internet it's easy to start thinking there is guaranteed to be good results for any search, and that just doesn't seem to be the case. Especially with highly specified searches with 6-8 terms, you quickly enter the domain where you're reasonably unlikely to find an exact match.
- psyc 5y agoI've taken this possibility into account after the numerous recent threads about this, but I don't think it holds up. I'm very often able to find exactly what I'm looking for after 15 minutes of massaging search terms on 3-4 different search engines. The reason it feels like search has gone to hell, for me, is that for 20 years I took for granted that I could type the first terms that came into my mind into one search engine (Google) and the result I wanted was the first result. Outside of programming-related topics, anything I search returns pages of pop psychology listicles or news articles. Since I am literally never looking for pop psych listicles, Google (and, to be fair, the other search engines as well) has become a lot less usable. I agree that the open web has deteriorated, with crap drowning out real content. But I maintain that Google et al have failed, or been beat. The content is there, they just can't find it and/or rank it anymore.
- marginalia_nu 5y ago> I'm very often able to find exactly what I'm looking for after 15 minutes of massaging search terms on 3-4 different search engines. If you are adjusting your query, then you are going to get different results, possibly including ones that contain the information you want (but not your original search terms). We've been tweaking search terms to find what we were looking for since day one, what's changed the most it's that it's gotten far less likely that you'll realize you need to do this. I think this is one of the real drawbacks of ML-algorithms, their failure modes are completely incomprehensible. Dumb algorithms we can grok, and learn to help along the way when it doesn't work. There is really no point where it will always work.
- gregallan 5y agoI think this is my biggest problem with how Google now works. It's always been disappointing when you didn't find what you were looking for. But you used to be able to examine the results and see how your search terms might not have been optimal, and adjust accordingly. It was the expectation that you'd have to tweak. Now, changing your exact search terms hardly seem to make a difference. I think the major difference is that the algorithm used to highly weight matching of specific words and phrases from the search terms, so adding a word, re-ordering, and swapping for synonyms would drastically change the results. Now it seems they're using ML and natural language processing to try to actually understand what you're looking for and give it to you. You can change your search terms, but the language embedding doesn't change much, so the system is actually working as intended. I could see that this might actually be desirable for a large segment of the population who wants their search engine to "just work" in response to natural language queries. If the corpus being indexed was high quality, maybe this would be a good experience. But due to the ads, affiliate marketing, and blogspam that make up a large part of modern internet content, it's simply frustrating. I wouldn't be surprised if they've done user testing that validates their approach. Programmers tend to be comfortable with the concept that a computer will do what you ask, even if it's not what you meant, but most people want to get the right results on the first try. The natural language/ML approach may be much more intuitive and forgiving in that regard. It's just not an approach that's compatible with the low average quality of the content being indexed, in that it takes away the authority of the user to improve their search results. I think there's somewhat of a tradeoff in search performance between quality of results on the first try and ability to improve the results on subsequent tries, and google is now optimizing for the former at great cost to the latter. And honestly they're failing at both.
- xwolfi 5y agoEither google failed, or the pop science listicles have won ... they're not passively being indexed, sorry you found them by mistake. They actively and aggressively create completely artificial content, tailored not at humans but at google, so that they can push the latest stupid ad for some telephone company on you. It's like bitcoin if you want - they compete for something so useless the entire concept becomes a huge waste of time. Search engine SEO is like hashrate-dependent token mining: the only people who win are the farmers at the cost of burning their entire ecosystem.
- pja 5y agoEven programming related topics now return heavily SEOd sites with instead of high quality programming content. Often the SEOd content is not completely awful for these searches, but it’s usually not great & never as good as the best sites.
- Sander_Marechal 5y agoMost often it's a rip of StackOverflow surrounded by spammy ads
- sshine 5y agoYes, the more popular terms you search for, the more muddy the waters get. If you search for anything related to sexuality and psychology, the results are littered with sites that were squatted for serving ads (i.e. no relevant content, just ads), poor quality articles with very low quality content (e.g. poorly formed Quora questions with no expert answers). As with anything, you have to know what search terms for a given subject are good. For example, you'll get more objective answers the more academic sounding you are, because the fewer people have tried to occupy those search terms.
- mhitza 5y agoIf I'm searching for a development issue, and my first results page contains 2-3 sites that 1-1 copy stackoverflow/github issues, then Google has failed. I doubt those can be more authorative than the original sources
- andriesm 5y agoI agree with your experience - to me it also seems I used to enter a search phrase and get back a page of results that exactly match it, these days, I often get things that only vaguely thematically relate to my search phrase instead. Sometimes I would change a word in my search phrase or add an extra word to make the intent much more specific and still get essentially the same search results!!! Terrible, just terrible.
- WalterBright 5y agoOn Amazon I searched in "CDs & Vinyl" for the band "The Birdstones". It showed me results in books. Criminy. Amazon does this all the time. If I wanted a book, I'd have searched under "Books". I am not confused about the difference between "CDs" and "Books". What's the good of having categories if they're completely ignored?
- aix1 5y agoI was curious and tried it myself. The search results page explains -- right at the top -- what is happening: Showing results from All Departments No results for The Birdstones in Music, CDs & Vinyl I think this widening of search scope is not unreasonable.
- cik 5y agoIt depends how you view the problem. If one assumes that humans make mistakes - it's probably reasonable to show people things outside their selected search scope. If you're an exacting user, this is rather frustrating. Realistically neither of the above were the concern. It's an attempt to boost engagement in the hopes that you'll find a product for eventual purchase, nothing more.
- aix1 5y agoI didn't design this UX, so can't be certain of the designer's intent. However, more charitable interpretations could be: 1. perhaps the user has accidentally chosen the wrong category? 2. perhaps the product they're looking for is miscategorised? (I've definitely seen these.)
- pjc50 5y ago> There is so much stuff on the Internet it's easy to start thinking there is guaranteed to be good results for any search, and that just doesn't seem to be the case. I'm increasingly of the opinion that Google (the advertising engine) has destroyed Google (the search engine), by the two step process of making it profitable to produce blogspam then forcing search to remove blogspam - and a lot of the useful content has gone out with that bathwater. Not to mention the rise of unsearchable platforms. Google can't search inside Discord.
- kreeben 5y ago>> Google can't search inside Discord. Can anyone, even in theory? Are there open APIs to all systems of discord? Does Discord have one? Wouldn't that open up all of these systems to systematic classification of all users? Also, is there a web link you can construct that will open up e.g. Discord's desktop app when you click it?
- krageon 5y agoSearching Discord externally is not possible AFAIK. It's an actively user-hostile platform, which is doubly irritating because most community efforts (e.g. modding of games) mandate Discord and allow for nothing else. Frequently they don't even accept communication from another space, such as bug reports via email or GitHub.
- ciphol 5y agoThat is good for privacy though.
- lpcvoid 5y agoNo - anonymous accounts are good for privacy. If you're contributing information about something, having that information index-able is just common sense.
- krageon 5y agoIt's practically mandatory to "verify" your account with a phone number for many servers. Discord is incredibly anti-privacy, the fact that it is not transparent to people that aren't currently using it is a vendor lock-in measure.
- eitland 5y ago> I think in part that Google just has gotten a spectacularly confusing failure mode. If it can't find good matching contents, it starts second-guessing your query and producing other results, which makes you think it's not even considering what you entered. This is probably part of it but not the whole explanation: Try to search on Google for: slack ngrok When I and others did earlier today there were a number of pages that contained the words including from the slack.com domain. The top result however was a page that didn't contain ngrok at all. I saw a specialist at another search engine comment that it was because it was a very popular result (at least thats what I read into it). Here's my problem with Google: they are either just really bad at QA or they don't care or they consistently overestimate their dumb AI and underestimate me. I'm fed up. Not including pages that doesn't contain the search terms or anything similar isn't hard when there are multiple good results at the exact same domain / pagerank, is it?
- meragrin_ 5y ago> underestimate me. Given the term "ngrok", I can't say I blame them/it. It looks like a typo to me. I imagine for well over 90% of people searching, it would be a typo. Perhaps, it is a common typo?
- eitland 5y agoWell, it is a well known tool for temporary tunneling of http. Google knows and the rest of the results confirm it. Now, if your explanation was the entire explanation it would be kind of ok if they did like Kagi do and Google did themselves at some point, ask nicely: did you mean <something else>? or we included results for <something else>. Please use doublequotes if you want exact matches. Of course with Google this would be pointless as as far as I can see they ignore doublequotes anyway these days...
- acdha 5y agoThat’s the key part: a decade ago, that search would have worked perfectly well. They removed the tools for fixing the problem so they own it.
- estebarb 5y agoSome funny example is "Eclipse": Do you mean Eclipse the IDE? Or the vampire movies? Maybe you mean the astronomical event? or the Nissan Eclipse car? Or you wrote wrong ellipse? I'm fine with Google not reading my mind at the first try, but at least offer me alternatives and exact text matching. For example since a couple of years looking for phones or symbols is completelly broken. And I really admire how Google is able to guess the encoding of the websites, detect what is text, do language detection and dropping all the porn. Writting a crawler that actually works is HARD.