4 ms·
Domain authority is a distributed 'trust' system? But you want 'manually curated' but not 'crowd sourced', which suggests you want an individual to or small gr
by pbhjpbhj 7y ago
Domain authority is a distributed 'trust' system?
But you want 'manually curated' but not 'crowd sourced', which suggests you want an individual to or small group to find, record, and curate all pages (? or domains, or <articles>, or ...) across more than 60 Billion pages of content??
There's something like 1000 FOSS CMSs - I would be surprised if there's a million domains with relevant info to sift through just for that small field.
There's no way you're curating _all_ that without crowd sourcing.
Of course you don't have to look at everything to curate, but how are you going to filter things ... use a search engine?
- cy6erlion 7y agoIs there a way to get a list of every domain in existence?
- pbhjpbhj 7y agoThis https://www.whoisxmlapi.com/whois-database-download.php https://www.whoisxmlapi.com/whois-database-download.php is a start, but there's new ones every second so you're going to need to update a lot. I think it's not possible as domains don't have to be registered necessarily - a server can serve a domain at a particular IP so long as the requesting client uses a domain that the server responds to. Obviously if it's registered domains then you can in theory just get the list from the registrar. They probably sell the full list for a price. I imagine you can harvest a list with sufficient resources.
- cy6erlion 7y agoThank you! this is very helpful for me.