4 ms·

Do not use Selenium for web scraping

• snaky 8y ago
  > The only exception that I could see for using Selenium as web scraping tool is if a website that you are scraping is using JavaScript to get/display data that you need to scrape. Like 95% of web sites?
  • sasa_buklijas 8y ago
    Scrapy does have the solution for JavaScript with Splash, but I have never used it, so far I always found some workaround.