4 ms·

DDG has its own index now, though it still augments that with other sources. https://help.duckduckgo.com/results/sources/ https://help.duckduckgo.com/results/s

DDG has its own index now, though it still augments that with other sources. https://help.duckduckgo.com/results/sources/ https://help.duckduckgo.com/results/sources/

sct202 6y ago
Does the DDG bot actually do a lot of crawling? I've never seen anyone talk about it except that it exists, while for Bingbot, Googlebot and random chinese bots in the webdev forums I go to people complain all the time about excessive crawling.
Kiro 6y ago
Their own index is not used for any organic search results, only Instant Answers and other widget stuff. Money quote from your page: > We also of course have more traditional links in the search results, which we also source from multiple partners, though most commonly from Bing (and none from Google).
- qchris 6y ago
  I agree that quote is there (and have read the surrounding context), but it doesn't seem to me that it actually says that DuckDuckBot results aren't used in any non-Instant Answer search result, which I think is a distinction. They're very clearly synthesizing results from multiple sources, including many from Bing, but neither that page nor the DuckDuckBot-specific page seem to directly exclude the use of their internally-crawled results in the non-Instant Answers search results. Did I perhaps miss something?
  - Kiro 6y ago
    You're right but at the same time they say that they source their "traditional links in the search results" from "multiple partners", which to me seems to imply that it's from partners only and not their own crawler. Try searching for something random like "woxioai" on DDG and you will see that the search results are identical to Bing (albeit a slightly different order but I presume they do some internal sorting at least), while the search results are completely different on Google.

4 ms·

DDG has its own index now, though it still augments that with other sources. https://help.duckduckgo.com/results/sources/ https://help.duckduckgo.com/results/s

by andreareina 6y ago

DDG has its own index now, though it still augments that with other sources. https://help.duckduckgo.com/results/sources/ https://help.duckduckgo.com/results/sources/

sct202 6y ago
Does the DDG bot actually do a lot of crawling? I've never seen anyone talk about it except that it exists, while for Bingbot, Googlebot and random chinese bots in the webdev forums I go to people complain all the time about excessive crawling.
Kiro 6y ago
Their own index is not used for any organic search results, only Instant Answers and other widget stuff. Money quote from your page: > We also of course have more traditional links in the search results, which we also source from multiple partners, though most commonly from Bing (and none from Google).
- qchris 6y ago
  I agree that quote is there (and have read the surrounding context), but it doesn't seem to me that it actually says that DuckDuckBot results aren't used in any non-Instant Answer search result, which I think is a distinction. They're very clearly synthesizing results from multiple sources, including many from Bing, but neither that page nor the DuckDuckBot-specific page seem to directly exclude the use of their internally-crawled results in the non-Instant Answers search results. Did I perhaps miss something?
  - Kiro 6y ago
    You're right but at the same time they say that they source their "traditional links in the search results" from "multiple partners", which to me seems to imply that it's from partners only and not their own crawler. Try searching for something random like "woxioai" on DDG and you will see that the search results are identical to Bing (albeit a slightly different order but I presume they do some internal sorting at least), while the search results are completely different on Google.