3 ms·

How could i grab a website and execute js on this site to get the complete dom?

3 points by addisaden 14y ago

Hi everybody, is there a way to grab the website and execute the javascripts? Some Websites inject Content via Javascript and Ajax and it would be great to get these. I am porgramming in Ruby. Maybe there is a way to do this with NodeJS? Thank you for your help

deeds 14y ago
Have you looked at Capybara + Capybara-webkit? with the :js => true option set on your test cases, you might have some success. And it's still ruby, which is nice. https://github.com/jnicklas/capybara#calling-remote-servers https://github.com/jnicklas/capybara#calling-remote-servers https://github.com/thoughtbot/capybara-webkit https://github.com/thoughtbot/capybara-webkit
wmf 14y ago
You can do this with Node+jsdom or PhantomJS.
- addisaden 14y ago
  Thank you. PhantomJS looks great.
mmccomb 14y ago
Selenium is capable of doing this and has a Ruby driver (library from which it can be controller). http://selenium-client.rubyforge.org/ http://selenium-client.rubyforge.org/