3 ms·
I can picture hundreds of data pack-rats writing the exact same shell script, hoping they're not too late :)
by shykes 16y ago
I can picture hundreds of data pack-rats writing the exact same shell script, hoping they're not too late :)
- deleted 16y ago[deleted]
- il 16y agoIf anyone wants to hack on this together, shoot me an email (email in my profile) I'm thinking of some...interesting uses for the data.
- ig1 16y agoJust realized this only covers company search, although the same issue is there for people search: http://www.crunchbase.com/search/advanced/people/1250638 http://www.crunchbase.com/search/advanced/people/1250638 Interestingly it looks like people search gets hit much more often than company search which is the opposite of what I would have guessed. I wonder how long it's going to take for someone to make a high-score table of the most searched founders and startups ;-)
- nletourneau 16y agohere, have the first step: curl -s http://www.crunchbase.com/search/advanced/people/1250638 http://www.crunchbase.com/search/advanced/people/1250638 | grep advanced_search_query | cut -d\" -f12
- sharpemt 16y agoLikely much faster ways of going through this but to expand on your thought: #!/bin/bash for (( i=1; $i < 1250646; i++)) do curl -s http://www.crunchbase.com/search/advanced/people/$i | grep advanced_search_query | cut -d\" -f12 >> people.txt done