If you like Go, I’ve had good success on a few projects with http://go-colly.org/ http://go-colly.org/ . It’s significantly easier than using the https://godoc.

If you like Go, I’ve had good success on a few projects with http://go-colly.org/ http://go-colly.org/ . It’s significantly easier than using the https://godoc.org/golang.org/x/net/html https://godoc.org/golang.org/x/net/html package directly where you would otherwise have to juggle cookies and whatnot to perform authentication tasks.