3 ms·
Such a pity. I have always used DMOZ as a source for seeding any search engine I am playing around with as you get a good breadth of sites to start crawling. H
by boyter 10y ago
Such a pity. I have always used DMOZ as a source for seeding any search engine I am playing around with as you get a good breadth of sites to start crawling.
Half tempted to create an open clone to keep it going. Any suggestions for a name would be appreciated.
EDIT - Ordered freemoz.org and will attempt to get somthing going ASAP
- greglindahl 10y agoThe blekko slashtag dataset is a lot better, just sayin: https://github.com/blekko/slashtag-data https://github.com/blekko/slashtag-data (the founders of dmoz were the founders of blekko)
- boyter 10y agoLooks like a good data source to seed with.