3 ms·
They should revive their original concept: a web directory. The internet has enough dumb crawlers, the problem I want to see solved is quality and trust.
by kube-system 4y ago
They should revive their original concept: a web directory. The internet has enough dumb crawlers, the problem I want to see solved is quality and trust.
- fumar 4y agoI tried to start this project before leaving Yahoo. At least in my orbit, no one was interested. I could’ve done a poor job of communicating the idea but there was/is too much churn after the Apollo acquisition.
- deleted 4y ago[deleted]
- version_five 4y agoI think google is actually a web directory or portal masquerading as a search. At least that's how I use it, and I suspect most people do. I generally know the internet sites where I want to get information, and I'm definitely not using google to discover then. Google lets me deep dive to a site and content, saving a step vs going to the site, and probably searching better than a site's native search. Stack Overflow is the archetypal example of this. And Google's pretty good for it, once you learn to dodge some ads and spam. At the same time, the internet is mature, so most people are doing less site discovery and going back to a set of regulars, so the deep link portal model serves people well Otoh what Google's terrible at is finding new sites with interesting content. If you don't already know where your going, you mostly end up in spam land. I'd like to see a search that addresses that.
- kube-system 4y agoCrawlers used to be good for discovering interesting and good content, before the advent of SEO. Now that this model has been compromised, that's why I think a more curated option would be advantageous in today's world. I would love to have a general resource with 1/1000000th the content if the content was consistently high quality. Also, I loved that you could just browse the old Yahoo by category.
- b112 4y agoSEO existed certainly in the late 90s, and was likely around about 10 seconds after the first SE was created.
- noduerme 4y agoI bet GPT-3 let loose to crawl the web could whip up something like the original Yahoo hierarchal, curated directory structure pretty quickly. It wouldn't be as good as employing dozens of people to actually read and rank websites, but it would be a start. Browsing through directory trees is complimentary to search, and has its own power for surfacing unexpected connections, i.e. information you didn't necessarily know you were looking for. I would love to see something well maintained like that again.
- kube-system 4y agoIt would certainly be better than the status quo of site ranking. Asking ChatGPT for websites about a topic does a fairly decent job, it seems. At least, it doesn't give me any spam.
- flandish 4y agoYet. Give it time and when asked “find me the owners manual for a 2004 jeep wrangler” it will list a few sites, probably one with the pdf in there, and then a few “need a new used car?” links too…
- noduerme 4y agoHah. So true. And it'll direct you to a used car site where all the marketing content was written by... ChatGPT. Then again, replacing used car dealers with Terminators could be an improvement.
- mattw2121 4y agoAbsolutely agree. I loved DMOZ and was a faithful volunteer for several years. Maybe the time has past and it would be too ripe for gaming the system. Finding dedicated volunteers that "stick to the mission" would be the key. Not sure how possible that is in today's world. Back then we didn't really think about providing this free labor to some company. We were just grateful that someone was hosting such a thing and we had the chance to contribute.
- gremlinsinc 4y agoI think it'd be fun/cool to start a DMOZ, that basically uses a crawler that runs every page of a site through gpt-3 to get the top 10 categories the site belongs to, and figure a way to basically do what DMOZ did via human editors with ai, it'd still allow for human overrides and suggestions etc, but wouldn't require or rely on it.
- Double_a_92 4y agoAgree. That would also help to discover random interesting things. The question is if it should be human/user curated, or automatically generated with e.g. some AI.
- papito 4y agoWe are coming in full circle hard. I started using newsletters aggressively - it's a good way to keep on top of your interests. Mastodon is similar to the old decentralized discussion boards - each server run by its own admins, and specific to a set of narrow topics.