Google search has been noticeably worse than the old days for some time now, and others aren’t much better. It seems that they’ve solved the problem of crawling

Google search has been noticeably worse than the old days for some time now, and others aren’t much better. It seems that they’ve solved the problem of crawling and indexing the infinite graph of the internet by limiting it to smaller and smaller portions of the graph, and continuously pruning old content. The small sites of the internet are nearly extinct. Personal sites, self hosted blogs, forums, etc have all gone by the way side, but how much of that trend is due to algorithmic reinforcement? Maybe we hit a point where they just got too difficult to distinguish from spam sites and we just didn’t notice as more and more of the internet was filtered out.