4 ms·
Crawling the internet for mp3s. It took us a couple of months to get to 7m.
by mo0 12y ago
Crawling the internet for mp3s. It took us a couple of months to get to 7m.
- tixocloud 12y agoThat's an absolutely creative way of doing it! Congrats. I'm interested in how you did it. For example, how do you exactly "crawl the internet"? Did you have a bunch of sites that you've pre-selected and then just crawl those or did you actually follow through on links? Thanks.
- tk42 12y agoOne-click hosters and cloud hosters with sharing options(such as docs.google.com), several music streaming sites, usenet. Also the amount of mp3s hosted on regular webservers which are indexed by and easily found using the usual search engines is mindblowing
- rubicon33 12y agoI am also interested in knowing more specifics about your crawling process (if you can divulge). Did you just crawl random sites and search for .mp3 content on them? Or did you have a set of pre-defined search sites to craw?