4 ms·

What are you talking about? I search reddit using google all the time !?

• chatmasta 10y ago
  https://www.reddit.com/robots.txt https://www.reddit.com/robots.txt Disallow: /*/comments/*?*sort= Disallow: /r/*/comments/*/*/c* Disallow: /comments/*/*/c*
  • NoodleIncident 10y ago
    It works fine. I don't know if there's a way to get only comments, but if you scroll down to the link to /r/madlads it's clearly indexing them. "site:reddit.com don't quote me" I use this all the time to search specific subreddits for phrases in comments I remember, but I don't want to give examples or subreddits I visit.
    • monksy 10y ago
      > /r/madlads Look at this maverick!
    • chatmasta 10y ago
      He actually used the site: keyword! The absolute madman!
  • jedberg 10y ago
    Those only block the various sorts and individual comment links. The main comments pages are still searchable. Google was getting overzealous and indexing every page hundreds of times because it would follow every link, which included every "context" link and every sort.