This brought to mind this site which got attention several years ago: https://millionshort.com/about https://millionshort.com/about Maybe 5 or 10 years ago.

This brought to mind this site which got attention several years ago: https://millionshort.com/about https://millionshort.com/about Maybe 5 or 10 years ago. It's a search engine that filters out the top N websites. However I just tried it and it seems to be poorly maintained -- it's crashing on certain queries, and giving me captchas after only a few searches. Some people noticed this problem many years ago, and here is a solution which didn't quite work. But it might be something to learn from in attacking this problem.