3 ms·
> While the change detection currently only runs on a subset of about 2 million domains, the crawler is aware of approximately 36,000,000 domains in total, and
by tart-lemonade 1y ago
> While the change detection currently only runs on a subset of about 2 million domains, the crawler is aware of approximately 36,000,000 domains in total, and about 1,500,000 of those are subdomains of tumblr.com.
So Tumblr makes up ~4% of all internet domains (or at least, all linked publicly-accessible domains)? Makes sense, but still wild to think about. I'd love to know what the top 10 domains (by sub-domain count) are.
- marginalia_nu 1y agoHere's top 25 as far as marginalia's domain awareness goes +---------+------------------+ | CNT | DOMAIN_TOP | +---------+------------------+ | 2445090 | tumblr.com | | 915418 | blogspot.com | | 712132 | wordpress.com | | 244369 | bandcamp.com | | 236676 | uptodown.com | | 115058 | github.io | | 99616 | substack.com | | 83419 | deviantart.com | | 78243 | livejournal.com | | 73866 | weebly.com | | 71687 | wixsite.com | | 68073 | informer.com | | 67849 | medium.com | | 65004 | knoji.com | | 59438 | blogspot.co.uk | | 59412 | list-manage.com | | 41923 | itch.io | | 41150 | mystrikingly.com | | 40743 | ibooked.dk | | 39978 | fnxradio.com | | 35671 | blogspot.ca | | 34450 | site123.me | | 33889 | ibooked.nl | | 33649 | xuijs.com | | 30391 | infospaceinc.com | +---------+------------------+