3 ms·
Feedburner: I've thought about this one, but I haven't been able to find a good starting point. Their vast collection of RSS feeds don't seem to cross referen
by iamelgringo 17y ago
Feedburner: I've thought about this one, but I haven't been able to find a good starting point. Their vast collection of RSS feeds don't seem to cross reference nicely and lend themselves to an obvious spidering strategy like web pages do. Suggestions on how to start are welcome
karma++ for wget google news. I looked at feedage, but signal:noise ratio kinda sucks.
- jacquesm 17y agoTread carefully when spidering google, mail me for some more info on this. Being IP banned from google is not funny.
- scrollbar 17y agoOuch, the Google ban stick does not sound fun. An alternative for spidering high-risk avenues like that might be 80legs.com, in essence a legal/opt-in crawling botnet =P I've used them when they were in open beta and the service was free -- now you need to pay, although it's pretty cheap for smallish jobs.