2 ms·
Eh it's possible, the reviews are harder though. I wrote a scraper which pulled address info / phone number / star rating / review count for pretty much every
by Tostino 9y ago
Eh it's possible, the reviews are harder though.
I wrote a scraper which pulled address info / phone number / star rating / review count for pretty much every restaurant in the US.
It was "easy" because all of that data is available within the search page, and you just need to correctly parse it out.
The hardest part was getting around their really crazy rate limiting and IP blocking.
I managed to get myself IP banned from yelp prior to ever trying to scrape by just doing a bunch of searches manually pretty quickly over like 20 min, next thing I knew I could no longer access anything on Yelp.
- monksy 9y agoThat's not suprising. You can get yourself IP blocked just by opening things in other tabs to queue them up to read. (If you notice yourself getting random 404s .. that's when you're being watched)