4 ms·
Some sites will say you can't scrape. They'll say so in their TOS if that's the case. If you absolutely need that info, there are ways to not look like a spider
by dgunn 14y ago
Some sites will say you can't scrape. They'll say so in their TOS if that's the case. If you absolutely need that info, there are ways to not look like a spider. One way is to use a browser driver (pretty heavy option so I would just not use those sites for now). I can't remember the name of the browser drivers available, but that's one possibility. I doubt they'll have libraries for your languages though.
I would definitely recommend python for web scraping. There are a ton of tutorials out there. I believe there are even a few from Google which are pretty good.
- gurpreet42 14y agoThanks for your suggestions. I will try python for my further efforts.