I'm curious why you used BeautifulSoup when scrapy has its own built-in HTML parser (HtmlXPathSelector). Is there an advantage to BeautifulSoup or is it just t

I'm curious why you used BeautifulSoup when scrapy has its own built-in HTML parser (HtmlXPathSelector). Is there an advantage to BeautifulSoup or is it just the tool that you're most comfortable with?