13 ms·
DuckDuckGo’s quest to prove online privacy is possible
- mywacaday 5y agoThe best use I have found for DDG is when on mobile I use chrome and when a website says you have reached your max articles per month just share to DDG and and read away
- DoingIsLearning 5y agoAnecdata, I've switched to DDG as my default search engine on both desktop and mobile. At the beginnning I would still go back to google for technical queries, but by now I have accepted that DDG is actually better at excluding spam/SEO stuff than google. Also the fact that it actually honours keywords like 'site:' 'domain:' is a huge time saver. The difference may be regional or specific to my areas of interest so perhaps your mileage may vary but to me DDG has improved substantially in the past 2 years whereas google just seems to increasingly just push for this natural language paradigm and discard my specific query, showing instead whatever popular approximation it chooses (I can only assume this probably saves them a tonne of resources and caters to >90% of users). The only feature I still feel google is unmatched is 'regional' online shopping discoverability. The 'Google Shopping' service is still the go to place for me to find specialist physical stores near me that also have an online retail front.
- dont__panic 5y agoOn mobile, I find DDG incredibly useful because it doesn't send me to AMP pages (which are inevitably broken), and on iOS I can't install any browser extensions to redirect me away from that mess.
- swiley 5y agoDoes anyone have an explanation for DuckDuckGo censoring the "tank man" image during the recent anniversary of Tiananmen square?
- Daedren 5y agoDDG uses Bing's API for search.
- yegg 5y agohttps://twitter.com/yegg/status/1401216879293874185 https://twitter.com/yegg/status/1401216879293874185 "China banned DuckDuckGo in 2014 and we have no plans to change that. This image belongs in search results and never disappeared from our main page. For the image tab we mainly use Bing and they fixed the error. We’re looking to supplement w/ more sources."
- mda 5y agoThey also mainly use bing for everything else.
- yegg 5y agoThat’s not really true — I put more on that here: https://news.ycombinator.com/item?id=27528625 https://news.ycombinator.com/item?id=27528625
- sct202 5y agoI just went and repeated all my google searches from this morning, and the only knowledge cards that I got were from Wikipedia and the rest of the results were ads or the "blue links." I'm a little confused if the instant answers/knowledge cards refers to a larger piece of the results that blends in?
- mda 5y agoSo, what percentage of ddg's results for queries come from bing? like a ballpark estimate. Is it like 10%? 50%? 80%? Because in your answer you still carefully avoid giving any actual numbers. I still say (by looking at the results for random queries) that ddg is is mostly bing, do you have any actual data to refute this?
- 5y ago
- kemonocode 5y agoI have some skepticism in those regards, at least unless they make use of their own crawlers. Bootstrapping themselves with different information sources as they've been doing is good for the very beginning as then they serve as a privacy-respecting aggregator to those sources, but as the tank man incident proved, you run the risk you'll be made complicit to censorship, whether intentionally or not.
- yegg 5y agoSearch has changed a lot in the past decade or so. Now most results pages are full of instant answers, e.g., knowledge graph responses (which we do completely ourselves) and local results (for which we have our own index + Apple Maps and local providers like TripAdvisor). In other words, it isn’t just one index, but about 20 that really matter in terms of adoption. Additionally, people engage with the first thing on the page about twice as much as the second thing, and that second thing about twice as much as third thing, and so on. That means if instant answers are near the top (increasingly the case) it means that those sub-indexes are increasingly more important as they are engaged with relatively more than the traditional “10 blue links." A lot of that traditional web index is also used for just navigational purposes, which we can easily do ourselves. We are already crawling for our tracker blocking data set, encryption data set, and several other things. In other words, we do make use of our own crawlers, and also have the ability to change some things around for indexes we use, which we do routinely. However, you need all of these indexes to make search work well, and have them all come up at the right times (a lot of what we do in search ourselves). In this context, I think people elevate the long-tail “web index” too much. Should we have satellites in space to make good maps? It is also necessary for search. Should we be collecting sports and stocks data ourselves? Also necessary for search, but no one really calls on us to do that. Our approach has been to partner with the best data providers in each vertical so we can provide the best alternative to Google search. And when nothing exists or it isn’t good enough, we do it ourselves or add layers on top. To that end, it isn’t binary — there is a lot in between and in fact that’s the way it works today.
- kemonocode 5y agoThank you for taking the time to explain things at least. I don't personally rely that much on "instant answers"- at least for the things that I'm most likely to have to look up, but I can see why they're so useful. EDIT: Also, back to the point: any plans when it comes to only relying on Bing for images? That was the issue in the end- least how I understood it.
- pmoriarty 5y agoMy biggest problem with DDG (which has been my search engine of choice since it began) is that there's no way to verify its privacy claims. Ideally it would be continually audited by multiple trusted third parties.. something maybe like the EFF. Even then there'd be no guarantees, but it'd be way better than what users have now, which is just DDG's claims.
- deepstack 5y ago>Ideally it would be continually audited by multiple trusted third parties.. something maybe like the EFF. For a for profit company, the third parties such as EFF would be good enough for most users. Would highly recommend that EFF offer some sort of certificate (PGP signed key would be fine) to authenticate such audit.
- jacobmarble 5y agoI have switched to Neeva (neeva.com) which has no ads, because you are the paying customer. So far, it's been a great experience. I have had to get used to paying attention to the first few results, which are usually ads in Google or DDG. While there is no privacy audit that I'm aware of, the theory is that there is no motivation to sell my searching habits to anyone. DDG plans such a feature, but it will likely never be their primary revenue driver.
- ghastmaster 5y agoThe greatest feature of DDG in my opinion is that it does not put you into a bubble. Results are the same regardless of what I have been searching lately. Does neeva allow you to toggle features like that?
- freediver 5y agoNeeva's model is great but execution is suboptimal. Two examples: - While Neeva has no ads, they prioritize sites with tons of ads in their results (search for 'best laptop'). If your main premise is that ads are bad, why not penalize/remove second order sites that are heavy in ads? - They claim they respect user privacy, yet make technical choices like using raw Google maps in their product as Maps module, which sends requests from the client directly to Google
- shantnutiwari 5y agoI have been using DDG for a few years, and find a few problems with their results: * Some spammy links slip thru-- these are dumb sites with lot of stuffed keywords and zero actual content. I dont get these with Google. I've usually seen these when searching for questions related to email list providers, like Aweber or Activecampaign * Last year, I started getting random porn results for harmless queries, like "Monster videogame 2010". Again, didnt get these on Google. For these reasons, Im hesitant to recommend DDG to non-technical users. Why I stick with DDG-- I like to search in private windows, and Google harasses you everytime to accept their terms and conditions. On my iPhone, if I have 10 tabs open, I'll have to do this 10 times. DDG saves me a lot of this hassle. For me, the privacy is a bonus, but like other commenters have said, there is no way to verify these claims.
- ajdoingnothing 5y agoI like to search in private windows, and Google harasses you everytime to accept their terms and conditions. I use incognito too for almost everything. However, I thought that the terms & conditions popup was only a Youtube thing (it drives me insane too)... I guess they haven't rolled it out to everyone yet.
- shantnutiwari 5y agoYeah, I get them for both Youtube and google
- boomboomsubban 5y agoFor 2, what are you leaving safe search at? When off, that seems like it's probably correct behavior for a search engine, and google removes it as people find it undesirable.
- shantnutiwari 5y agoWhatever the default is-- I guess safesearch on? It only happened for a brief time, so I guess it was a bug in DDG. But when it did happen, it was serious enough I stopped using DDG at work completely.
- Santosh83 5y agoHow about distributed crawlers coupled with a distributed datastore similar to Freenet? Your browser automatically crawls the pages you visit and adds the info to the distributed index that is also stored on all participating machines (perhaps with a copy on the cloud for query performance). Though a single browser may visit only a few pages, we ought to get a pretty good WWW index from the combined crawling of millions of browsers. Main advantage would be resistance to censorship.
- gostsamo 5y agoSome indexes are really big. Plus, when you index a page, you must be sure that you are not indexing your email inbox. It would be better if the index is on the cloud, while the crawlers are distributed, but are not part of your browser.
- fartcannon 5y agoI don't know if I can use DuckduckGo after finding out they so strongly rely on Microsoft that their search results end up censored like Microsofts. I try to use these alternatives to lessen the absolute power of google and Microsoft, not quietly boost them. My fault, really.
- Karsteski 5y agoYou know what they say, just make your own search engine. I'm glad people are coming around to the fact that information is now controlled by a few giant tech companies.
- decasteve 5y agoDDG relies on Microsoft for both search results and hosting as far as I can tell. The site itself is served from Azure endpoints.
- gerash 5y agoIt's interesting that DDG runs on Azure and uses Bing as its backend. That makes me wonder if this whole privacy theater of DDG is the new iteration of Microsoft's "scroogled" negative campaign. As much as I hate corporations who resort to smearing their competitors instead of elevating their own offerings it looks like it does change public opinion and essentially works in practice.
- golfer 5y agoCan anyone comment on the claims about DDG in this article? I see this pop up from time to time: http://techrights.org/2020/07/02/ddg-privacy-abuser-in-disguise/ http://techrights.org/2020/07/02/ddg-privacy-abuser-in-disgu...
- nescioquid 5y agoThe histrionic name-calling makes it difficult to take seriously. The standard criticisms of DDG are nestled in a sticky ooze of weird accusations like "Tor Project accepted a $25k “contribution” (read: bribe) from DDG", or "DDG consumed a room at FOSDEM 2018 to deliver a sales pitch".
- thera2 5y agoUnlike most people here it seems, I started using DuckGo few years ago and have no issues at all. Everything works well or well enough, and although you cant verify their privacy claim, I certainly know it's as private if not more than Google at the very least.
- tomjen3 5y agoI use it as my main search engine because google puts up a super annoying cookie banner if you are not logged in or have approved them before and that doesn't work with temporary containers (a genius extension for firefox that presents each new tab with its own cookie jar, making sites isolated not just from each other but even from other tabs that access the site).
- Taylor_OD 5y agoI use DDG on my computer and phone. I like it a lot. Took me about 6 months to get used to how it searched and once in a while I still need to use !g to get google results. That is a very easy trade off for more privacy.
- godshatter 5y agoI have been using DDG as my main search engine for a few years now. I occasionally try out other search engines, but I haven't been to Bing (directly) or Google for many months at least. DDG is "good enough" for me. If I can't find a reasonable result to my query, I work on modifying my search terms or just give up. Having said that, my main concern is that someday in the future DDG will be sold to some less ethical company and I'll have to abandon it (having to start the search for a new search engine of choice all over again).
- mwint 5y agoI’ve switched over to DDG as my default search engine across all devices/browsers. It’s not as good as Google - but it’s perfectly good enough for 95% of searches. For that other 5%, it’s usually programming-related queries where everyday words take on new meanings. Since DDG doesn’t tailor search results, it has a harder time with some of my uncommon word usage. For those, it takes two seconds to append “!g” at the end of the query to go to Google; it’s barely disruptive to my workflow. I’ve noticed myself doing that less and less since I switched in January. Perhaps a combination of DDG getting better, and me getting better at tailoring my queries for it.
- marvinblum 5y agoI've started using DDG last month and fallen back to Google for a few searches as the results are just better. DDGs results are often "good enough", but not quite on point as Google is. You can literally type in a question on Google and get an answer. DDG requires more thought of what you type in and you have to scan more results. First page is usually good enough, but I find myself changing the keywords more often than I did on Google. Overall I'm quite happy with it and use it on a daily basis.
- Semaphor 5y agoMy only issue with DDG (which is my main searchengine), is that they often ignore keywords (google is catching up to them though… do people really enter random terms that they don’t want to search for?), annoyingly without telling you that they ignored the term (google does), and even worse, sometimes this happens when you force a search term with "’s. That’s almost exclusively the reason I need to do !g. And as bing doesn’t have the same issue, it has to somehow be them actively sabotaging my search.
- approxim8ion 5y agoUnverifiable privacy claims aside, I quite like that DDG is suitable for most (80%+) things I need to look up. Having !bangs to jump to wiki (or google) has been great too. That said, it is not without faults, even functionally. - Local search is naturally very poor, to the point that 100% of my local search traffic is still on Google. - Image search is nothing to write home about. - I'm not pleased that looking up something contentious/political more often than not brings up reactionary or false content. It's either bad news sources or low quality blogs. The last one might not be a problem to people whose opinions the results align with better but it is what it is. It's hard to say whether this is what the web would be without Google "censorship"/filter bubble stuff, or whether these are just the kinds of content the DDG (bing + other sources) algorithms have decided to rank ahead of them. Either way, it is an invaluable resource and an important one to have. Search is already extremely concentrated towards Google but ideally there should always be usable alternatives.
- dont__panic 5y agoAgreed, with one caveat: DDG image search, in my opinion, is far superior to Google Images because it still allows you to right click -> save image and right click -> open image in a new tab (and it actually opens the image, not the page that contains the image). Google Images has been deteriorating every year for over a decade now.
- luke2m 5y agoExactly. The view file button is also very useful.
- GuB-42 5y agoAbout Google Image, it stopped doing direct links as a result of a lawsuit by Getty Images. How does DDG get away with it? Another advantage of DDG/Bing is the ability to really turn off safe search. Unlike Google, it will not try to guess if you want nudity or not based on your search query, resulting in weird situations where you have to look for porn in order to get "anatomically correct" pictures.
- soheil 5y agoEvery time a DDG article pops up on HN people start praising it and how it's 95% as good as Google, etc. DDG uses Google's and other search engines' data. DDG does not do their own crawling. Please do a quick search here on HN and read up on all the previous conversations about privacy and security implications of that before selling the narrative that DDG is somehow more awesome than more established search engines.
- Nicksil 5y ago>DDG uses Google's and other search engines' data. DDG does not do their own crawling. >Please do a quick search here on HN and read up on all the previous conversations about privacy and security implications of that before selling the narrative that DDG is somehow more awesome than more established search engines. I'm not sure I understand your argument. What are the privacy and security implications? If you submit a query and DDG turns around and gathers the results elsewhere, those other sources would have no idea it was you submitting the query; all they see is a request from DDG. Sounds like a better deal than directly exposing yourself to the sources you mention.
- soheil 5y agoIs this true? Even if you’re not exposed to those sources you’re exposed to DDG instead, so are you saying they have somehow more moral grounds to stand on when it comes to not sharing user data with others given that they see no problem with taking Google data and semi-packaging it as their own in the first place?
- Nicksil 5y ago>so are you saying they have somehow more moral grounds to stand on when it comes to not sharing user data with others given that they see no problem with taking Google data and semi-packaging it as their own in the first place? That isn't at all what I said nor implied. The gist of my comment was DDG is the lesser evil of all parties involved. Your statement: > DDG uses Google's and other search engines' data. DDG does not do their own crawling. Please do a quick search here on HN and read up on all the previous conversations about privacy and security implications of that [...] (emphasis mine) You draw a connection between the potential third parties involved and the adverse affect to the individual's privacy and security stemming directly from their involvement. I was outlining that, if DDG was sending the request to those parties -- not the individual making the query -- the other parties wouldn't be aware of the individual unless DDG explicitly tells them (which I don't believe they do).
- losvedir 5y agoI haven't used DDG much but I tried for a while to use Bing (which, I believe serves most of its organic search results in the US?), since Microsoft had a thing for a while where they'd basically pay you to use their search engine. But even with that, I eventually found myself back on Google. So I'm not inclined to try DDG for a while anyway. Whatever happened to Brave? Aren't they working on a search engine, too. Anyone know if that similarly uses Bing, Yandex, etc, for the search results or if they have their own crawler? It's been a while since I've looked in depth at user agent logs to see if Brave is making an appearance.
- iusethemouse 5y agoBrave are working on their search engine, they have been slowly inviting people to start using it (I got my invite a couple of weeks ago). As far as I know, it doesn't rely on other search engines for its results, although they do provide an optional setting to enable Google fallback in case a query doesn't return enough results, which mixes in Google results together with Brave's own. Overall, I've been finding it pretty good. It has information cards for various entities on the right-hand side, similar to all other search engines. You can additionally search for images, news, and videos.
- codyb 5y agoI'll just chime in with my experience as well. Long time DDG user. Barely use bangs at this point. Haven't switched back to Google in ages. I don't really do much local searching, but it seems like that's an issue. When I do local searches I just quantify things "Best Thai food in <My Neighborhood>", but I live in area heavily traversed by food critics (I tend to avoid group reviews like Yelp, and Amazon which I tend to think of as easily gamed in favor of newspaper critics and Consumer Reports or America's Test Kitchen, an approach with its own pros and cons). Most things seem fine although the other day I got a ton of porn when I did an image search for an artist I was discovering "Rico Nasty". Thank god for work from home! As an aside, I find Google's search result interface extremely off putting at this point. I'm not exactly sure what it is? It seems like there's barely any results above the fold, it's much noisier with widgets everywhere, and why are the description strings only a sentence long at max? I downloaded a new copy of Chrome (or maybe it was the one that popped up from Cypress tests or something and I errantly used it as main browser window), and yeagh.
- butz 5y agoIt's annoying when search results throws everything at you: youtube videos, images, product carousels, etc. Probably they should add new section to search "text only" and ignore "rich" media results. Also related suggestions boxes after returning to search results gets old fast and are not useful at all. I need to get to next result in list, not start a new search.
- svat 5y agoIt would be nice if there were a tool of some sort where I could type a search term and on two halves of my screen the results from Google Search and from DuckDuckGo would appear… after trying that for a month or two, one would be better informed how the results differ, and be more confident about switching (one way or the other). I've had the idea for a while of writing for myself such a tool (probably can't be a browser extension?), but I haven't gotten around to it yet. Does one already exist, or is trivial to write? As I type this comment, I found that at the commandline on macOS one can do, say: open -a "Google Chrome" "https://duckduckgo.com/?q=umbrella" open -a "Google Chrome" "https://www.google.com/search?q=umbrella" (or whatever your usual browser is) and it's easy to wrap that in a script: function search() { open -a "Google Chrome" "https://duckduckgo.com/?q=$*" open -a "Google Chrome" "https://www.google.com/search?q=$*" } This (invoke like say `search freddie mercury`) opens two tabs and I haven't yet figured out how to open them in side-by-side windows, but maybe I'll try for a few weeks to be disciplined about doing all searches this way, and see how it goes. Seems worth finding out!
- ricardo81 5y ago>macOS At least on Linux it's likely doable with xdotool, it should let you identify the windows and put them where you want them.
- latexr 5y agoOn macOS it’s doable[1] with AppleScript[2]. [1]: https://news.ycombinator.com/item?id=27534252 https://news.ycombinator.com/item?id=27534252 [2]: https://en.wikipedia.org/wiki/AppleScript https://en.wikipedia.org/wiki/AppleScript
- Zhyl 5y ago> I haven't yet figured out how to open them in side-by-side windows Two iframes side by side? https://stackoverflow.com/questions/23737427/how-to-put-two-iframes-side-by-side https://stackoverflow.com/questions/23737427/how-to-put-two-...
- asdf54231 5y ago
- Tomte 5y agoI've just repeated my experiment from https://news.ycombinator.com/item?id=19043565 https://news.ycombinator.com/item?id=19043565 DDG's results haven't gotten any better for that specific search.
- freediver 5y agoDuckDuckGo has shown the world that building a privacy respecting search engine is possible. It brought an alternative to mainstream tracking based search. I'd like to see DDG innovate more as the product seems stale at this point. 10 years have gone by and the product hasn't evolved much, feels pretty much the same. It seems they are in some kind of contractual Bing Search/Ads dependency lockdown preventing them from innovation in search. Also, are ad-based business models really what we want from the web? On the other hand I can see them saying 'what we are doing has worked pretty well in the past, lets continue doing that".
- gbmatt 5y agoA project I'm involved with https://private.sh/ https://private.sh/ has search privacy that is more verifiable than ddg. It uses client-side cryptography in the javascript, and routes your request through an anonymizing proxy, similar to how TOR works. The encrypted query is only readable by the search engine, in this case, gigablast, whereas the independent proxy scrubs your IP address.
- holstvoogd 5y agoAlways ironic how many trackers are blocked when reading such articles
- npteljes 5y agoWhen using DDG I sometimes curse the bad results. Stupid DDG, I think, open google.com in a private tab, do my search, only to realize that google is not returning anything useful either. Modifying the keywords a bit, I get my results, and finally pasting the same keywords to DDG, surely, my results would have been the same too.
- seoaeu 5y agoPersonally, the nagging "I wonder if Google results would be better" is enough of a reason for me to not use Bing/DDG/etc. A search engine is a tool and it is hard to be productive when you can't trust your tools.
- 3np 5y agoI run an instance of searx[0] for me and friends. It is very easy to set up and will aggregate results across DDG/Google/Bing/plenty of others if you wish. Strips tracking parts of links and can trivially do other rewriting you may want. Easy to add filter lists to remove blogspam domains, pinterest et al. Bonus; you won't leak your actual client IP to any of them. Comes with morty[1], which is a decent "anonymizing" HTTP proxy. Supposed privacy wins completely aside, it's the best search user experience I've had in many years. You do run the risk of getting CAPTCHA'd but so far I've had 0 of that with the above-mentioned. [0]: https://github.com/searx/searx https://github.com/searx/searx [1]: https://github.com/asciimoo/morty https://github.com/asciimoo/morty
- npteljes 5y agoChange is hard, one has to appreciate that. Productivity is not everything. I did my share of changes over a long time, and bit by bit, and this helped me to separate my resistance to change, and the actual pros and cons of the systems.
- jeroenhd 5y agoI've got a lot of trouble with some technical Googling that just doesn't get the right results in DDG. I assume it's because the algorithms have adjusted to my interests, but it's making using DDG for professional purposes quite hard sometimes.
- AdamN 5y agoI wish DDG would have a toggle for the privacy/speed/other attributes of the destination site. I'd like to set minimums and simply never see those sites in my results. This would require allowlists and easy disabling for targeted searches but would generally stay enabled.
- squiggleblaz 5y agoHow could they have any knowledge of the privacy settings of the target site?
- thekyle 5y agoIf they crawled the sites themselves, then they could detect tracking code and allow users to filter out sites with that (filter by no ads, no analytics, no paywall, etc.) However, since they mostly just use Bing I don't know how easy that would be.
- MR4D 5y agoI wonder why the Mozilla foundation never came up with a search engine of their own. Something tells me it could be quite popular. Too bad they get so much money from Google. Otherwise this might be cool.
- Threeve303 5y agoImagine how valuable Google would be if people believed they protected privacy.
- chunsj 5y agoI just cannot understand this statement of how DuckDuckGo's quest proves online privacy is possible; at least here in South Korea, DuckDuckGo has been under the control of arbitrary censoring of government which means the communication is under watch.
- hzay 5y agoI searched "why men are stronger than women" in Google and DDG a few days ago. Very different results. Google seemed to be telling me I'm a bad person for thinking these bad things.
- deleted 5y ago[deleted]
- deleted 5y ago[deleted]
- 1vuio0pswjnm7 5y ago"Like Google Search, DuckDuckGo makes money by selling ads on top of people's search results. The difference is that while the ads you see when searching on Google are generally targeted to you in part based on your past searches, plus what Google knows about your behavior more broadly, DuckDuckGo's are purely "contextual"-that is, they are based only on the search term." Search options [ ] No ads [ ] Contextual ads [ ] Targeted ads What would users choose if given the choice.