The robots.txt does not prevent Google from scraping the quote page, which is the one that matches for me: https://www.goodreads.com/quotes/11541816-few-hundre

The robots.txt does not prevent Google from scraping the quote page, which is the one that matches for me: https://www.goodreads.com/quotes/11541816-few-hundred-years-of-western-society-that-we-have-lost https://www.goodreads.com/quotes/11541816-few-hundred-years-... The robots.txt seems to exclude things which are genuinely useful to exclude, like RSS feeds.