4 ms·

So I wonder if we can trick Googlebot into doing computations for us? Maybye mine bitcoins! :-)

• frik 12y ago
  This could work, especially on high-ranked news sites that are crawled every few minutes for new content. I just noticed a comment on HN that I wrote a few minutes ago, was already in Google search results - was shocked a bit.
  • bhartzer 12y ago
    They're indexing blog posts and content within seconds, not minutes. I've seen my blog posts indexed within seconds and they've been doing that for a few years now.
    • Raphael 12y ago
      The best way to achieve this is with PubSubHubbub to avoid the delay of polling your feed or pages. (Not that it would necessarily stop.)
    • 0x0 12y ago
      That's probably because a default wordpress install has pingomatic.com listed in the callbacks for on-post ("update services").
  • marcosdumay 12y ago
    I had a not-important site with many pages, for a while Google was crawing it continuously, with 10 threads in paralell.
• tantalor 12y ago
  An old trick is to use abuse the crawler to generate a huge index for reverse lookups. For example, reverse "72b302bf297a228a75730123efef7c41" to md5("banana").
• ihsw 12y ago
  Probably not. Googlebot likely has very fine-grained limitations on CPU/memory/IO usage, and penalizes websites that use too much. Just a hunch.