3 ms·
why not use the twitter api?
by blyxa 14y ago
why not use the twitter api?
- bdreadz 14y agofrom the github page: Birdeater does not use Twitter's API. It was built as a demonstration of an approach I like to use for parsing structured information from unstructured HTML.
- TazeTSchnitzel 14y agoA better (and practical) example is scraping an internet forum (I've done it, partially)
- sshillo 14y agoapi has rate limits
- dbau 14y agoSo does this it seems: Be mindful when running it, as Twitter limits the number of requests that a single client can make per hour.
- wamatt 14y agoThe API probably has a key that can be blocked. Not that I'm advocating this, but a potential advantage of scraping, is it can be combined with tor or proxies, etc to get around limits.
- dmazin 14y agoIt's rate-limited to 150 requests per hour and you can only pull the 3,200 most recent tweets for a user.