I wrote a little program that does the "follow links and see if I find anything interesting" thing. It takes seed links, pulls all links that don't go back to t

I wrote a little program that does the "follow links and see if I find anything interesting" thing. It takes seed links, pulls all links that don't go back to the same domain, and then chooses 50 and repeats. Then there's another program to find the uncommon sites from everything gathered. Check it out at https://github.com/riley-martine/water_skimmer https://github.com/riley-martine/water_skimmer