3 ms·

I think this is what you mean: https://docs.google.com/spreadsheets/d/1mmfbNWaX0Nr1P65VmwZpm4WiceK7pepknSob4ti0M7s/edit?usp=sharing https://docs.google.com/spre

I think this is what you mean: https://docs.google.com/spreadsheets/d/1mmfbNWaX0Nr1P65VmwZpm4WiceK7pepknSob4ti0M7s/edit?usp=sharing https://docs.google.com/spreadsheets/d/1mmfbNWaX0Nr1P65VmwZp...

danso 10y ago
[insert quip about techcrunch.com] A little off-topic, but this reminds me of how non-straightforward it is to categorize what the true "domain" of a given URL. Blogspot.com has the most submissions by domain, but the API that runs the ?site query on HN returns just 5 links: https://news.ycombinator.com/from?site=blogspot.com https://news.ycombinator.com/from?site=blogspot.com I suspect that's because HN differentiates between somerandomdude.blogspot.com and googleblog.blogspot.com...but that in itself is an editorial/arbitrary decision...Why is subdomain more relevant for differentiation than for github, in which github.com/blog is grouped in with github.com/somedudesrepo? And FWIW, it seems subdomain faceting is done manually...education.github.com links are shown on HN's page as just github.com...whereas googleblog.blogspot.com's domain is fully listed.
- Tiksi 10y ago
  I feel like the best way to deal with this would be to group by subdomain if a domain has more than say 5 or 10 different subdomains submitted, but group by domain if there are less. That way "hosted" domains subdomains like *.blogspot.com get their own category, but domains controlled by a single entity are treated like a single category.
- kentonv 10y ago
  There is a well-defined solution to this problem: The Public Suffix List. https://publicsuffix.org/ https://publicsuffix.org/ blogspot.com is in it. github.com is not, but github.io (where Github Pages are hosted) is. I would guess this is what HN uses. That said, it of course can't help with e.g. categorizing github repo links by user, since those are by path rather than subdomain. Ah well.

I think this is what you mean: https://docs.google.com/spreadsheets/d/1mmfbNWaX0Nr1P65VmwZpm4WiceK7pepknSob4ti0M7s/edit?usp=sharing https://docs.google.com/spreadsheets/d/1mmfbNWaX0Nr1P65VmwZp...

danso 10y ago

[insert quip about techcrunch.com] A little off-topic, but this reminds me of how non-straightforward it is to categorize what the true "domain" of a given URL. Blogspot.com has the most submissions by domain, but the API that runs the ?site query on HN returns just 5 links: https://news.ycombinator.com/from?site=blogspot.com https://news.ycombinator.com/from?site=blogspot.com I suspect that's because HN differentiates between somerandomdude.blogspot.com and googleblog.blogspot.com...but that in itself is an editorial/arbitrary decision...Why is subdomain more relevant for differentiation than for github, in which github.com/blog is grouped in with github.com/somedudesrepo? And FWIW, it seems subdomain faceting is done manually...education.github.com links are shown on HN's page as just github.com...whereas googleblog.blogspot.com's domain is fully listed.

Tiksi 10y ago
I feel like the best way to deal with this would be to group by subdomain if a domain has more than say 5 or 10 different subdomains submitted, but group by domain if there are less. That way "hosted" domains subdomains like *.blogspot.com get their own category, but domains controlled by a single entity are treated like a single category.
kentonv 10y ago
There is a well-defined solution to this problem: The Public Suffix List. https://publicsuffix.org/ https://publicsuffix.org/ blogspot.com is in it. github.com is not, but github.io (where Github Pages are hosted) is. I would guess this is what HN uses. That said, it of course can't help with e.g. categorizing github repo links by user, since those are by path rather than subdomain. Ah well.