I tinkered with Apache Nutch (http://nutch.apache.org/ http://nutch.apache.org/), but I found it overkill. In the end, since I use Scala, I use https://github.c

I tinkered with Apache Nutch (http://nutch.apache.org/ http://nutch.apache.org/), but I found it overkill. In the end, since I use Scala, I use https://github.com/ruippeixotog/scala-scraper https://github.com/ruippeixotog/scala-scraper