Yeah, that's a good method to detect "soft 404s". I wrote a Python library for DecentURL to do this some time ago: http://blog.brush.co.nz/2008/01/soft404s/ htt

Yeah, that's a good method to detect "soft 404s". I wrote a Python library for DecentURL to do this some time ago: http://blog.brush.co.nz/2008/01/soft404s/ http://blog.brush.co.nz/2008/01/soft404s/ (Ironically, the original paper I got the idea from seems to be a dead link: http://www.tomkinshome.com/andrew/papers/decay/final/p444-baryossef.htm http://www.tomkinshome.com/andrew/papers/decay/final/p444-ba...)