4 ms·

I used slimer because scraper detection didn't pick it up as much. Beware that slimer (when I used in 2015) still require xvfb. Chrome headless should be faste

I used slimer because scraper detection didn't pick it up as much. Beware that slimer (when I used in 2015) still require xvfb. Chrome headless should be fastest. And if you're printing to pdf phantom and chrome had the better ability to do that.. I had each sidekiq job spinning up its own process -- and needed to do some X display avoidance.

dchuk 9y ago
Nice, thanks for the reply. Looking at their site, it looks like they now support a true headless mode: https://docs.slimerjs.org/master/release-notes-1.0.html https://docs.slimerjs.org/master/release-notes-1.0.html "With Firefox 56 and more, SlimerJS can be trully headless by adding the –headless option on the command line" So that could be an interesting thing to play with. I've thought about just having my sidekiq jobs spin up a docker container with the browser in it and then just limiting the amount of jobs at once for resource constraints, and now seeing your comment I think I might just give it a shot.