6 ms·
I found this old thread, where pg had blocked most of the Google bots, and it caused Google to think the site was down: https://news.ycombinator.com/item?id=32
by Roedou 13y ago
I found this old thread, where pg had blocked most of the Google bots, and it caused Google to think the site was down:
https://news.ycombinator.com/item?id=3277661 https://news.ycombinator.com/item?id=3277661
Could be a similar issue? I'll take a look.
- Roedou 13y agopg also commented that he doesn't want traffic from Google anyway: https://news.ycombinator.com/item?id=5808990 https://news.ycombinator.com/item?id=5808990 In which case, he should add: <meta name="googlebot" content="noindex"> to the html head of every page. (I have to say, that's a smart way of avoiding any Eternal Septembering, but it'd be a shame. I often use Google to find old HN threads that I vaguely remember from months or years ago.)
- dnautics 13y agoyou may want to consider using hnsearch.
- saurik 13y ago(Google's search is often better for this purpose as it has features like synonym/typo fixing and as it indexes entire pages lets you match keywords across entire threads: hnsearch is myopic on individual posts.)
- snogglethorpe 13y agoYup... Even sites with good search functions are often still way outclassed by google search with "site:..."—and most sites don't have good search functions...