3 ms·

Thanks for answering. > We have provided our results to multiple metasearch engines over the years and currently provide them to a number of people for various

by Seirdy 6y ago

Thanks for answering. > We have provided our results to multiple metasearch engines over the years and currently provide them to a number of people for various uses. Are you able to name any? Also: what (if any) are some "starting points" for your crawl? I know that Right Dao uses Wikipedia dumps as one of its sources, for instance.

mojeek 6y ago
https://www.etools.ch/ https://www.etools.ch/ is one. We originally seeded it with URLs from DMOZ. Now we have our own page weight that in combination with modified dates decides what is crawled and when.