21 ms·
Yeah, one thing I would like to create in my web-scale crawling activities is some structured data discovery tools. Google surfaces a few things as part of thei
by greglindahl 8y ago
Yeah, one thing I would like to create in my web-scale crawling activities is some structured data discovery tools. Google surfaces a few things as part of their search results, but not in bulk.
This project http://webdatacommons.org/ http://webdatacommons.org/ extracts from Common Crawl, but it's just raw data and you're on your own for visualization and discovery tools!
- lsh 8y agoThanks again - it was very easy to install and use. I think something like this: https://www.ssllabs.com/ssltest/ https://www.ssllabs.com/ssltest/ but for embedded data would be interesting.