4 ms·Ruby & Nokogiri gem. You can also use Anemone gem to crawl the complete website.by Madeindjs 9y agoRuby & Nokogiri gem. You can also use Anemone gem to crawl the complete website.