3 ms·
Hi Colin, Given that you run your own spider, presumably you provided it one or more urls to get started spidering. I'm curious what those were.
by lsiebert 6y ago
Hi Colin,
Given that you run your own spider, presumably you provided it one or more urls to get started spidering. I'm curious what those were.
- ColinHayhurst 6y agoIt was originally seeded with URLs from DMOZ, when Marc first stared working on Mojeek.