Have you done much scraping in the past? There's normally a lot more to it when javascript is involved, captcha systems etc. This is obviously helped recently

Have you done much scraping in the past? There's normally a lot more to it when javascript is involved, captcha systems etc. This is obviously helped recently by the relatively new headless modes for Chrome & Firefox, but before that it was using buggy headless implementations or Selenium. These weren't well suited to operations at scale.