I was surprised to find Twitter doesn't block their crawler. https://web.archive.org/web/20061109101219/http://twitter.com/public_timeline https://web.archive.

I was surprised to find Twitter doesn't block their crawler. https://web.archive.org/web/20061109101219/http://twitter.com/public_timeline https://web.archive.org/web/20061109101219/http://twitter.co...