4 ms·
Having used it in some early work on our search engine, CC does not update near often enough or crawl a big enough portion of the web to be competitive with com
by Grimm1 6y ago
Having used it in some early work on our search engine, CC does not update near often enough or crawl a big enough portion of the web to be competitive with commercial crawling solutions. It's a great thing that exists, don't get me wrong, but it's better for researchers looking to amass a dataset versus competing in search.