3 ms·
You will get to initial source code with this, but if you want JavaScript to work, you just use PhantomJS. If you want PhantomJS to be usable, you is casperJS..
by integrii 9y ago
You will get to initial source code with this, but if you want JavaScript to work, you just use PhantomJS. If you want PhantomJS to be usable, you is casperJS... Until you find a site with FuzeJS or some other JavaScript or html intense site. Those won't render in PhantomJS.
For that stuff, as of a few months ago, you can use Chrome headless. I wrote a couple go packages to make that easy. It basically runs headless chrome with a JavaScript REPL console you can use to interact with the session. https://GitHub.com/integrii/headlessChrome https://GitHub.com/integrii/headlessChrome
I was also able to smash my while scraper bot into a docker container after working around a couple bugs.
- stcredzero 9y agoIt basically runs headless chrome with a JavaScript REPL console you can use to interact with the session. That looks cool! Would I be able to run Node scripts?
- simlevesque 9y ago> Would I be able to run Node scripts? No. Since you can't run Node scripts on Chrome, the same is true for Chrome headless.