3 ms·

As for the YouTube-DL part specifically, I'm pretty sure that's a side-effect of them being dependent upon Bing for the actual index: https://www.bing.com/searc

As for the YouTube-DL part specifically, I'm pretty sure that's a side-effect of them being dependent upon Bing for the actual index: https://www.bing.com/search?q=site%3Ayoutube-dl.org https://www.bing.com/search?q=site%3Ayoutube-dl.org Also, _come on_; if someone gives up after one search term, which also includes advanced site-restricting syntax, there's no way they'd be able to operate youtube-dl anyway: https://duckduckgo.com/?q=youtube-dl&ia=web https://duckduckgo.com/?q=youtube-dl&ia=web

muhammadusman 5y ago
Yeah idk why someone would type in the full URL of a site and not just the term they're looking for in a search engine...what a dumb way to test that on their part.
- miloignis 5y ago
  The point isn't that you can't reach the website by typing in the search term, the point is that they've deindexed the site. If you search for youtube-dl, neither youtube-dl.org nor yt-dl.org come up in the results, as far as I can see. You can still access it from the results via other sites, like github and wikipedia (which even makes the real website pop up in the info square, funnily enough), but the search results themselves do not contain any links to the main website.
- daxuak 5y ago
  What if I want to search what sites have mentioned those urls?
  - lolinder 5y ago
    That's still the wrong syntax.
- ykonstant 5y ago
  Absolutely! Why on earth would you test a dumb way of doing things on a user-facing service?! slams hand on desk Irrelevant!
- CincinnatiMan 5y ago
  The article doesn't explain it well, but if you search for just `youtube-dl` (without the "site" prefix), the main youtube-dl.org site is still not present in the search results.
maxk42 5y ago
They don't rely solely on Bing. If a popular site doesn't appear, it's definitely a conscious decision on their part.
- lucb1e 5y ago
  ... or the domain list comes from Bing and they additionally feed some of that to their own crawler or... This seems like an oversimplification of things you don't know.
chimeracoder 5y ago
DuckDuckGo is not solely dependent on Bing. They use Bing as one sourc of the, but they've run their own crawlers since at least 2012.
- mardifoufs 5y ago
  Not for actual search IIRC. Last time I checked, they only used their own index and crawlers for the "smart search" and instant answers. Almost all of their search results are still sourced from Bing. That's pretty easy to check for yourself, usually whenever something does not show up on Bing it won't on DDG either. A good example of that was when the "tank man" picture disappeared from Bing and the exact same thing happened on DDG.
  - dredmorbius 5y ago
    Yandex was also previously used for search, largely of Russian sites. That relationship has reportedly been "paused": https://www.protocol.com/bulletins/duckduckgo-yandex-ukraine https://www.protocol.com/bulletins/duckduckgo-yandex-ukraine

muhammadusman 5y ago

Yeah idk why someone would type in the full URL of a site and not just the term they're looking for in a search engine...what a dumb way to test that on their part.

miloignis 5y ago
The point isn't that you can't reach the website by typing in the search term, the point is that they've deindexed the site. If you search for youtube-dl, neither youtube-dl.org nor yt-dl.org come up in the results, as far as I can see. You can still access it from the results via other sites, like github and wikipedia (which even makes the real website pop up in the info square, funnily enough), but the search results themselves do not contain any links to the main website.
daxuak 5y ago
What if I want to search what sites have mentioned those urls?
- lolinder 5y ago
  That's still the wrong syntax.
ykonstant 5y ago
Absolutely! Why on earth would you test a dumb way of doing things on a user-facing service?! slams hand on desk Irrelevant!
CincinnatiMan 5y ago
The article doesn't explain it well, but if you search for just `youtube-dl` (without the "site" prefix), the main youtube-dl.org site is still not present in the search results.

maxk42 5y ago

They don't rely solely on Bing. If a popular site doesn't appear, it's definitely a conscious decision on their part.

lucb1e 5y ago
... or the domain list comes from Bing and they additionally feed some of that to their own crawler or... This seems like an oversimplification of things you don't know.

chimeracoder 5y ago

DuckDuckGo is not solely dependent on Bing. They use Bing as one sourc of the, but they've run their own crawlers since at least 2012.

mardifoufs 5y ago
Not for actual search IIRC. Last time I checked, they only used their own index and crawlers for the "smart search" and instant answers. Almost all of their search results are still sourced from Bing. That's pretty easy to check for yourself, usually whenever something does not show up on Bing it won't on DDG either. A good example of that was when the "tank man" picture disappeared from Bing and the exact same thing happened on DDG.
- dredmorbius 5y ago
  Yandex was also previously used for search, largely of Russian sites. That relationship has reportedly been "paused": https://www.protocol.com/bulletins/duckduckgo-yandex-ukraine https://www.protocol.com/bulletins/duckduckgo-yandex-ukraine