3 ms·
Why does it matter how many useless urls they visit? If you're trying to fix the "expired link" issue -- there are better ways to fix that. I think you should
by jules 19y ago
Why does it matter how many useless urls they visit? If you're trying to fix the "expired link" issue -- there are better ways to fix that.
I think you should ban google too if you ban the others. The only disadvantage I can see is that people from here who want to find something they've seen on news.yc can't use google anymore.
- pchristensen 19y agoBlocking a crawler is a one liner that could be done in a couple seconds. Tackling the limitations of a continuation based architecture is a bigger problem.
- jsrn 19y ago> [...] can't use google anymore. I think pg should just make a search link on top of the site pointing to http://www.searchyc.com/ http://www.searchyc.com/ or http://nycs.bigheadlabs.com/ http://nycs.bigheadlabs.com/