2 ms·

it could be an open source project, i'd be interested

• TomAnthony 15y ago
  You could start by playing around with this data: http://commoncrawl.org/ http://commoncrawl.org/ The ways you can interact with it currently are limited, but I think that'll improve.
  • alecco 15y ago
    That project looks amazing. But it'd be nicer to have some sort of compressed raw dump to use different tools.