7 ms·
How to build a good search engine: 1. Actually return the results matching the words that people typed in your search box. The more they match, the more they g
by moralestapia 6y ago
How to build a good search engine:
1. Actually return the results matching the words that people typed in your search box. The more they match, the more they go up.
More and more, it has become extremely disappointing what you get back from Google (and others as well). Verbatim search (where you surround exact terms in quotes), seems to have vanished in the last year or so. More often than not I have clicked on a result, only to find out that my particular query is nowhere to be found on the site, but some "related stuff" does.
- sixQuarks 6y agoI don't rely on Google anymore when I'm trying to find good information. I actually have much better results searching Reddit and HN for specific information.
- electrograv 6y agoI was not aware that HN had a search feature. Link?
- grzm 6y agoSee the footer.
- jsnell 6y agoThe search box is at the bottom of this very page.
- deelowe 6y agoType "[search term] news.ycombinator.com" or "[search term] reddit.com" into Google. If that doesn't work, you can reverse it "news.ycombinator.com [search term]" if you really want to limit to just hackernews. The former seems to work better for me most of the time.
- anon9001 6y agohttps://support.google.com/websearch/answer/2466433 https://support.google.com/websearch/answer/2466433 you actually want "site:".
- deelowe 6y agoNo need to downvote. I'm familiar with the keywords. My point was that omitting them sometimes produces better results. I suspect that putting hackernews in the query tricks it into realizing I'm looking for technical topics.
- tannhaeuser 6y agoIt's at the bottom of the page dude.
- Yizahi 6y agoAfter using HN for 6 years I just realized that it is there. Instead I had a separate bookmark to HN search for all these years :) . Apparently I just ignore footer completely as useless part of website.
- tannhaeuser 6y agoThere's room for slight improvements to the hn layout I guess ;) While we're at it, we could maybe place the logout link a bit further away from the profile link to avoid frequent inadvertent logoffs on mobile. Also, it's probably just me, but I haven't yet figured out how to post an Ask HN/Show HN.
- Sebb767 6y ago> Also, it's probably just me, but I haven't yet figured out how to post an Ask HN/Show HN. Isn't this just manually entering the prefix?
- tannhaeuser 6y agoI don't know. Is it?
- 0-O-0 6y agoI've used search several times, but each time I want to use it again I still waste time looking for it in the header instead of scrolling to the footer.
- electrograv 6y agoWow. I cannot believe I’ve been reading HN for so long and never noticed that. Thank you.
- wutbrodo 6y agoI share your frustration, but the obvious rejoinder is that most people don't agree with you. You can certainly target a relatively niche group of power-searchers, but most Google users probably think that the search engine guessing their intent is part of what makes it "good".
- HaloZero 6y agoHa. My parents actually do google.com just to type in something like facebook.com which searches and they find facebook. I doubt getting them to switch would be very easy unless you did some deal with browsers. But they like most others else uses Chrome, doubt Google would do that.
- Stratoscope 6y agoIt's not just your parents. I was sitting down with a very experienced C++ engineer a few months ago to work on a problem. There was something we needed to do a web search on. He opened Chrome, clicked in the address bar (which already had the keyboard focus, but never mind that), and typed "google". This did a Google search for Google, and the first search result was www.google.com. Then he clicked www.google.com which took him to the Google home page, and there he typed in the search terms. Yes, he Googled Google to do a Google search.
- tomcam 6y agoThat’s… That’s concerning
- Proven 6y agoYep. Another thing I see people do is to searching for stuff using GSE although the freaking link is already in their history (I'm not sure if "to their defense" is the right way to phrase this, but they also don't have the annoying search suggestions disabled so the amount of crap in browser UI perhaps overwhelms them)
- digisign 6y agoWell it's possible to be so focused on something that you know nothing about related subjects. Possible though not likely.
- xeeeeeeeeeeenu 6y ago>1. Actually return the results matching the words that people typed in your search box. The more they match, the more they go up. As virtually all early search engine developers have found out the hard way, it's extremely easy for website owners to cheat such a basic algorithm by spamming keywords.
- Anon4Now 6y agoBut the answer to that shouldn't be to return results that don't even contain the words searched for.
- deelowe 6y agoTypically, turning on verbatim helps with that.
- deleted 6y ago[deleted]
- WarOnPrivacy 6y agoWhere does one find that in DDG and Google?
- deelowe 6y agoNot sure about DDG. In google, it's under tools. Click the "all results" dropdown.
- eitland 6y agoOne of the reasons I finally gave up Google a couple of years ago was that verbatim hasn't worked reliably since maybe 2015 or something. Of course, around that time Duckduckgo started going downhill as well in this regard.
- WarOnPrivacy 6y ago> the answer to that shouldn't be to return results that don't even contain the words searched for. This is everything that's wrong with search in a single sentence.
- tech-historian 6y agoYour search engine is a spammer's dream. There's a million other things to consider. No thanks.
- tobyhinloopen 6y agoPagerank solved that, right?
- Spivak 6y agoFor a while, yes. That's part of what made it so novel. The fact that results are still full of SEO spam isn't really an indication that the right direction is to throw up your hands and make it easier to manipulate results.
- trissylegs 6y agoJust recently I was googling nftables (A replacment for iptables in Linux). Google decided iptables was a synonym and all the results were for iptables. (As it's older and more common)
- azinman2 6y agoTry “nftables” in quotes. It’ll help prevent query expansion.
- extempore 6y agoFYI there’s a search mode called verbatim, and it’s not the same as putting the individual words in quotes. It’s hidden under the search tools menu. In my experience the results it provides always contain the search terms.
- kwhitefoot 6y agoWhy on earth is that not the default?
- thu2111 6y agoBecause it's wrong for basically everyone. Spelling errors, stemming, etc. Most people want pages that match what they mean not what they typed and for natural language (vs programming topics) that's right.
- bambax 6y ago> Actually return the results matching the words that people typed in your search box That wouldn't take care of SEO spam, which is very good at stuffing its pages with whatever words people search for. Also, as much as I hate to admit it, Google is pretty good at guessing wrong spelling or synonyms and getting good results in a majority of cases.
- echelon 6y agoHow hard would it be to assign websites an actual reputation again? Include ads on the destination website as part of the reputation score. If a website is loaded with ads, sink it to the bottom. Google doesn't do this because they likely make money from the ads. Heuristically determine spammy content. It's pretty easy to tell at first glance which content is bullshit, so it's probably not hard to create an ML model to do the same classification. Manually assign positive weights to websites used by engineers and domain experts. You could even curate this list in the open and solicit help in maintaining it.
- cmm 6y agoit seems that the web has for at least a decade already been at the point where a search engine that is built to be useful by humans should (ideally, but apparently impossible with the current skewed incentives due to ad business considerations, overheated stock market, over-enthusiastic ML expert workforce, etc.) index only sites that opt _in_, vetted by humans. there is a clear upper bound on the amount of total legitimate web content, and that upper bound is not prohibitively high -- linear on the total number of coherent-content-producing humans with only so many hours in a day and only so many years of adequate brain functioning (and not on the amount of whatever computing resources that are thrown in to support whatever algorithmic content fire hoses that the currently-dominant search engines contend with).
- amelius 6y agoThe main problem: SEO.