2 ms·
Not too many. If they don't I just use Dapper, and then Yahoo Pipes if needed. Amazing "hack" about Yahoo Pipes... they block usage based on an IP accessing a
by sam_in_nyc 18y ago
Not too many. If they don't I just use Dapper, and then Yahoo Pipes if needed.
Amazing "hack" about Yahoo Pipes... they block usage based on an IP accessing a pipe. Yet, you can make that pipe access the "singleton" version of itself many times. So let's say you want to pull up Delicious tags of 10,000 URLs (something I did to generate very nice marketing data), you could access Delicious yourself 10,000 times (and get blocked very soon) or you can access a pipe (which accesses Delicious) 10,000 times... or you can access a pipe 100 times, each time sending it 100 URLs, and that pipe will just loop through and do it (Yahoo will count 1 access against you rather than 100). Since there are loads of pipes servers, and it's a semi-trusted source (in this case very trusted, since Yahoo owns Delicious), not all the Yahoo pipes servers will get blocked by Delicious. Actually, at the rate I was pinging them, some of them did actually get blocked :)
Another interesting experiment: Make a Dapper App which contacts Yahoo Pipes for an RSS. Make that Yahoo Pipe access the same Dapper App. Fun!
- sh1mmer 18y agoIf you like Pipes you should play with YQL (http://developer.yahoo.com/yql http://developer.yahoo.com/yql) it's much more like an API than Pipes given it's SQL-likeness. While it's actually my job to promote stuff for Y! YQL is one of my all time favourite things we have done and it really very much worth taking a look at. Especially given we just released "open tables" so now you can map any service to it, not just RSS, XML, CSV, etc feeds Disclaimer: I work for the Yahoo! Developer Network
- sam_in_nyc 18y agoYahoo! continually comes up with some amazing stuff. XPATH selection of a URL via a SQL like query (http://tinyurl.com/c5jrot http://tinyurl.com/c5jrot)... so awesome! Tell your coworkers that they've impressed me. And now, I test querying the page for itself. If your servers crash, it was all me.
- sam_in_nyc 18y agoThis has proven to be impossible