4 ms·

> They preemptively censor entire torrent sites They don't do that. That is a story that comes from a case of Bing, their upstream results provider, doing that

> They preemptively censor entire torrent sites They don't do that. That is a story that comes from a case of Bing, their upstream results provider, doing that, before quickly reverting the block.

WarOnPrivacy 10mo ago
> that comes from a case of Bing, their upstream results provider, doing that, Bing is just one of their sources. They run their own crawler. They source data from multiple 3rd party providers.
- flexagoon 10mo ago
  I know. I'm talking specifically about the source of the "DDG censors torrent sites" story.
  - WarOnPrivacy 10mo ago
    I'm saying DDG has spiders that index the web - and for ~every torrent site found by DuckDuckBot, DDG scrubs every bit of it from it's search results.
    - Imustaskforhelp 10mo ago
      I searched torrent sites on DDG just to test what you are saying and this isn't true or maybe I am not understanding but it shows me torrent sites links so I am not aware what you might be talking about.
      - WarOnPrivacy 10mo ago
        >> [DDG] preemptively censors entire torrent sites. > I searched torrent sites on DDG ... it shows me torrent sites links I can't speak to your search because you didn't post it. For my part, here are DDG results for widely used torrent sites (per reddit). https://duckduckgo.com/?q=site:1337x.tw https://duckduckgo.com/?q=site:rarbgdump.com https://duckduckgo.com/?q=site:limetorrents.fun https://duckduckgo.com/?q=site:torrentdownloads.pro https://duckduckgo.com/?q=site:extratorrent.st Interestingly, I did find that DDG isn't scrubbing Russian torrent sites from it's results. I think this makes sense if DDG is trying to compete with Yandex (who doesn't censor like DDG). https://duckduckgo.com/?q=site:uztracker.net https://duckduckgo.com/?q=site:rutracker.org https://duckduckgo.com/?q=site:piratesparadise.org (eng, hosted in Moldova)
        Imustaskforhelp 10mo ago
        I had just searched 1337x and nothing too much else so it seems that duckduckgo may (sensor?) the site:1337x.tw or similar but also I feel like ddg doesnt really censor the ability to find the website by just searchign 1337x Although I still agree that this is interesting discovery but I didnt know that these sites allowed to be indexed in the first place and that the issue was from ddg site, I always thought it was the opposite or didnt really give much too thought into it but interesting, I would love to discuss more about why you might think so this is the case or how it can meaningfully impact I suppose. I think that the issue here could be that there might be some censorship from big upstream or that ddg does it to prevent any legal issues which I am sure can open a load ton of questions if you scrape something tangentially related to copyright/similar so it might be understandable why they might do this I suppose.
        WarOnPrivacy 10mo ago
        > I feel like ddg doesnt really censor the ability to find the website by just searchign 1337x For us users, the point of search engines is to index the context of sites and tell us which one(s) have the info we're looking for. There isn't much point to a search engine that just tells us where a site is. Even less to tell us for a site we already know.
        WarOnPrivacy 10mo ago
        I did different searches and am getting some more results than I used to. This hash search gives one site: https://duckduckgo.com/?q=%229623748B411A3CD02DE8F332820C4C79352CE74E%22 https://duckduckgo.com/?q=%229623748B411A3CD02DE8F332820C4C7... This way also gives one torrent site: https://duckduckgo.com/?q=all+quiet+on+the+western+front+1930+%22torrent%22 https://duckduckgo.com/?q=all+quiet+on+the+western+front+193...
        flexagoon 10mo ago
        To be fair, 1337x.tw is a fake 1337x domain [1, 2]. It's bad that it's even indexed by DDG higher than the official one, I think it would be better if it was completely hidden from results. The .tw is a malicious website that actively tries to mislead users. For example, on the main page it says "1337x.to is our main domain", but when you click on that, you get redirected to "1377x.to" (notice the swapped digit), yet another fake clone website that conveniently lists the .tw as one of the official mirrors. Searching for site:1337x.to, which is the official domain, does give results. [1]: https://1337x-status.org/ https://1337x-status.org/ [2]: https://fmhy.net/unsafe#torrent-sites-clients https://fmhy.net/unsafe#torrent-sites-clients, see "fake 1337x sites"

> They preemptively censor entire torrent sites They don't do that. That is a story that comes from a case of Bing, their upstream results provider, doing that, before quickly reverting the block.

WarOnPrivacy 10mo ago

> that comes from a case of Bing, their upstream results provider, doing that, Bing is just one of their sources. They run their own crawler. They source data from multiple 3rd party providers.

flexagoon 10mo ago
I know. I'm talking specifically about the source of the "DDG censors torrent sites" story.
- WarOnPrivacy 10mo ago
  I'm saying DDG has spiders that index the web - and for ~every torrent site found by DuckDuckBot, DDG scrubs every bit of it from it's search results.
  - Imustaskforhelp 10mo ago
    I searched torrent sites on DDG just to test what you are saying and this isn't true or maybe I am not understanding but it shows me torrent sites links so I am not aware what you might be talking about.
    - WarOnPrivacy 10mo ago
      >> [DDG] preemptively censors entire torrent sites. > I searched torrent sites on DDG ... it shows me torrent sites links I can't speak to your search because you didn't post it. For my part, here are DDG results for widely used torrent sites (per reddit). https://duckduckgo.com/?q=site:1337x.tw https://duckduckgo.com/?q=site:rarbgdump.com https://duckduckgo.com/?q=site:limetorrents.fun https://duckduckgo.com/?q=site:torrentdownloads.pro https://duckduckgo.com/?q=site:extratorrent.st Interestingly, I did find that DDG isn't scrubbing Russian torrent sites from it's results. I think this makes sense if DDG is trying to compete with Yandex (who doesn't censor like DDG). https://duckduckgo.com/?q=site:uztracker.net https://duckduckgo.com/?q=site:rutracker.org https://duckduckgo.com/?q=site:piratesparadise.org (eng, hosted in Moldova)
      - Imustaskforhelp 10mo ago
        I had just searched 1337x and nothing too much else so it seems that duckduckgo may (sensor?) the site:1337x.tw or similar but also I feel like ddg doesnt really censor the ability to find the website by just searchign 1337x Although I still agree that this is interesting discovery but I didnt know that these sites allowed to be indexed in the first place and that the issue was from ddg site, I always thought it was the opposite or didnt really give much too thought into it but interesting, I would love to discuss more about why you might think so this is the case or how it can meaningfully impact I suppose. I think that the issue here could be that there might be some censorship from big upstream or that ddg does it to prevent any legal issues which I am sure can open a load ton of questions if you scrape something tangentially related to copyright/similar so it might be understandable why they might do this I suppose.
        WarOnPrivacy 10mo ago
        > I feel like ddg doesnt really censor the ability to find the website by just searchign 1337x For us users, the point of search engines is to index the context of sites and tell us which one(s) have the info we're looking for. There isn't much point to a search engine that just tells us where a site is. Even less to tell us for a site we already know.
        WarOnPrivacy 10mo ago
        I did different searches and am getting some more results than I used to. This hash search gives one site: https://duckduckgo.com/?q=%229623748B411A3CD02DE8F332820C4C79352CE74E%22 https://duckduckgo.com/?q=%229623748B411A3CD02DE8F332820C4C7... This way also gives one torrent site: https://duckduckgo.com/?q=all+quiet+on+the+western+front+1930+%22torrent%22 https://duckduckgo.com/?q=all+quiet+on+the+western+front+193...
      - flexagoon 10mo ago
        To be fair, 1337x.tw is a fake 1337x domain [1, 2]. It's bad that it's even indexed by DDG higher than the official one, I think it would be better if it was completely hidden from results. The .tw is a malicious website that actively tries to mislead users. For example, on the main page it says "1337x.to is our main domain", but when you click on that, you get redirected to "1377x.to" (notice the swapped digit), yet another fake clone website that conveniently lists the .tw as one of the official mirrors. Searching for site:1337x.to, which is the official domain, does give results. [1]: https://1337x-status.org/ https://1337x-status.org/ [2]: https://fmhy.net/unsafe#torrent-sites-clients https://fmhy.net/unsafe#torrent-sites-clients, see "fake 1337x sites"