2 ms·
What do you mean by "open"? Can the data be used for startups and other commercial purposes?
by spimmy 13y ago
What do you mean by "open"? Can the data be used for startups and other commercial purposes?
- res0nat0r 13y agoThe data is freely available: http://aws.amazon.com/datasets/41740 http://aws.amazon.com/datasets/41740 and you just need to comply with the Common Crawl TOU: http://commoncrawl.org/about/terms-of-use/ http://commoncrawl.org/about/terms-of-use/
- CrazedGeek 13y agoFrom the FAQ: "Please refer to the Common Crawl Terms of Use document for a detailed, authoritative description of our Terms of Use guidelines, but, in general, you cannot republish the data retrieved from the crawl (unless allowed by fair use), you cannot resell access to the service, you cannot use the crawl data for any illegal purposes, and you must respect the Terms of Use of the sites we crawl." http://commoncrawl.org/about/terms-of-use/ http://commoncrawl.org/about/terms-of-use/
- Aloisius 13y agoYes! Startups/commercial companies/etc can all use the data for free. The terms of use basically say, don't do anything illegal with it and a few other things, but it shouldn't affect the vast majority of uses. Actually, tomorrow a video on a startup that uses Common Crawl data is getting posted.