4 ms·

A shameless plug: https://github.com/scrapinghub/splash https://github.com/scrapinghub/splash is an open source tool similar to Phantom JS, and it has an intera

by kmike84 12y ago

A shameless plug: https://github.com/scrapinghub/splash https://github.com/scrapinghub/splash is an open source tool similar to Phantom JS, and it has an interactive web editor built-in. The concurrency model in Splash scripts is not the same as in Phantom JS scripts: Splash allows to use loops/ifs/functions in async code without recursion tricks or things like "casper.thenOpen". See http://splash.readthedocs.org/en/latest/scripting-tutorial.html http://splash.readthedocs.org/en/latest/scripting-tutorial.h... for more info. We haven't done a public announcement, and Splash is not yet feature complete, but it is used in production for more than a year, there are hundreds of unit tests and it is in active (though a bit sporadic) development - so give it a try if you want something different :) Installation is just "docker pull scrapinghub/splash" - see http://splash.readthedocs.org/en/latest/install.html http://splash.readthedocs.org/en/latest/install.html.

jakozaur 12y ago
Cool. Haven't heard about it. Will have a look. PhantomJS development seems stagnate a bit. Try to contribute to it myself.
- kmike84 12y ago
  I was under impression PhantomJS 2.x is rather active, but of course Splash contributions are welcome, that'd be great! Splash Web UI is quite similar to PhantomJS Pad UI - by default it shows a CodeMirror text editor (with a simple autocompletion) and a screenshot of the webpage. Also, by default it shows information about requests/responses (like a "Network" tab in Firefox/Chrome development console) and a textarea with rendered html. PhantomJS Pad UI ideas are good; tabs for images, an editor window which is open by default and a field with console logs make a lot of sense.
tonyrice 12y ago
There's also Automately (http://automate.ly/ http://automate.ly/) it's a pretty interesting platform and it also allows for use of browser automation but differently than PhantomJS it's a little confusing to get setup at first but once you're there it's easy from there on.
- kmike84 12y ago
  It doesn't look like Automately is open source, but their API looks nice (based on examples from http://blog.automate.ly/ http://blog.automate.ly/).
  - automately 12y ago
    We will actually be open sourcing our core very soon! We will also be including the source code for our SDK and Automately Pi (unreleased Raspberry Pi integration).
- curiously 12y ago
  interesting but seems like just a selenium in the cloud. wouldn't it make more sense for someone to host automation scripts on their own servers?
  - automately 12y ago
    It's actually more than that, our API doesn't only provide access to the Browser module. We provide an SDK that can help people build real-time applications that can connect with almost anything. We're getting ready to release our Raspberry Pi integration. We are also going to be going open source fairly soon.
    - curiously 12y ago
      how does the real time application benefit from automately?
      - automately 12y ago
        We've basically created a connected platform that makes it very easy to connect things. You can have your web application talk to your server-side automately scripts. We've made it as simple as including some JavaScript on your web page. Our server-side APIs make it very easy to communicate with APIs and WebSites. Your Automately scripts can store data via the DataBus and they can talk to other execution jobs via the MessageBus. Edit: Here's a very simple example http://searchproxy.automate.ly/ http://searchproxy.automate.ly/
deleted 12y ago
[deleted]
jwklemm 12y ago
Looks nice! I created a service called Ghost Inspector last spring that runs PhantomJS under the hood: https://ghostinspector.com/ https://ghostinspector.com/ It's not open source, but there's a free tier and lots of nice features built in like video recording, screenshot comparison and a GUI editor. If anyone is planning to write PhantomJS scripts directly, I strongly recommend checking out CasperJS: http://casperjs.org/ http://casperjs.org/ -- It gives you a really nice layer on top that makes Phantom much more wieldy.

by kmike84 12y ago

jakozaur 12y ago

Cool. Haven't heard about it. Will have a look. PhantomJS development seems stagnate a bit. Try to contribute to it myself.

kmike84 12y ago
I was under impression PhantomJS 2.x is rather active, but of course Splash contributions are welcome, that'd be great! Splash Web UI is quite similar to PhantomJS Pad UI - by default it shows a CodeMirror text editor (with a simple autocompletion) and a screenshot of the webpage. Also, by default it shows information about requests/responses (like a "Network" tab in Firefox/Chrome development console) and a textarea with rendered html. PhantomJS Pad UI ideas are good; tabs for images, an editor window which is open by default and a field with console logs make a lot of sense.

tonyrice 12y ago

There's also Automately (http://automate.ly/ http://automate.ly/) it's a pretty interesting platform and it also allows for use of browser automation but differently than PhantomJS it's a little confusing to get setup at first but once you're there it's easy from there on.

kmike84 12y ago
It doesn't look like Automately is open source, but their API looks nice (based on examples from http://blog.automate.ly/ http://blog.automate.ly/).
- automately 12y ago
  We will actually be open sourcing our core very soon! We will also be including the source code for our SDK and Automately Pi (unreleased Raspberry Pi integration).
curiously 12y ago
interesting but seems like just a selenium in the cloud. wouldn't it make more sense for someone to host automation scripts on their own servers?
- automately 12y ago
  It's actually more than that, our API doesn't only provide access to the Browser module. We provide an SDK that can help people build real-time applications that can connect with almost anything. We're getting ready to release our Raspberry Pi integration. We are also going to be going open source fairly soon.
  - curiously 12y ago
    how does the real time application benefit from automately?
    - automately 12y ago
      We've basically created a connected platform that makes it very easy to connect things. You can have your web application talk to your server-side automately scripts. We've made it as simple as including some JavaScript on your web page. Our server-side APIs make it very easy to communicate with APIs and WebSites. Your Automately scripts can store data via the DataBus and they can talk to other execution jobs via the MessageBus. Edit: Here's a very simple example http://searchproxy.automate.ly/ http://searchproxy.automate.ly/

deleted 12y ago

[deleted]

jwklemm 12y ago

Looks nice! I created a service called Ghost Inspector last spring that runs PhantomJS under the hood: https://ghostinspector.com/ https://ghostinspector.com/ It's not open source, but there's a free tier and lots of nice features built in like video recording, screenshot comparison and a GUI editor. If anyone is planning to write PhantomJS scripts directly, I strongly recommend checking out CasperJS: http://casperjs.org/ http://casperjs.org/ -- It gives you a really nice layer on top that makes Phantom much more wieldy.