3 ms·

Google Bot now crawls arbitrary Javascript sites

• mildweed 14y ago
  This will negatively affect tons of analytics tools. Time to start blacklisting googlebot UA strings from my custom javascript tracking tools.
  • grimboy 14y ago
    I'm pretty sure Google crawls with a client that looks like a real browser to check you're not doing thus type of thing.
• lorax 14y ago
  It is likely that googlebot is running the chrome browser, so anything you can do in chrome, googlebot can do too.
• sneak 14y ago
  I wonder how long it is until someone exploits the parallel nature of the googlebot's (presumably Chrome-based) javascript execution for general-purpose computation like mining bitcoins or something.
  • rallison 14y ago
    I imagine that Google imposes pretty strict limits on computation time for any javascript that is run, so I'm not sure how realistic that idea is.
    • grimboy 14y ago
      Yes. If it really were able to deal with arbitrary Javascript sites this would imply that Google had solved the halting problem.
    • sneak 14y ago
      I imagine that those limits are per-page, or perhaps per-domain.