11 ms·
Analyzing HN readers' personal blogs
- tuananh 7y ago> Static Site Generators how can that be detected ? I'm curious.
- type0 7y agoOr look for a link to the website source on github, gitlab etc and go from there. But that's more or less manual work given how many custom made SSGs there could be.
- elcomet 7y agoI'd say identify common templates? Or "made with Jekyll" blocks If it's a custom templates I think it's impossible.
- stevekemp 7y agoSome of them output META-tags, or footers such as "powered by XXX".
- Lammy 7y ago“generator” meta tag? https://html.spec.whatwg.org/multipage/semantics.html#meta-generator https://html.spec.whatwg.org/multipage/semantics.html#meta-g...
- saagarjha 7y agoJekyll only adds that if you use their “SEO” plugin: https://github.com/jekyll/jekyll-seo-tag/blob/0943563d0aac6013187c742f38b90fc576075fda/lib/template.html#L6 https://github.com/jekyll/jekyll-seo-tag/blob/0943563d0aac60.... (I don’t use that plugin, so I add it manually to mine.)
- Etheryte 7y agoIf I'm not mistaken, Jekyll also adds it in the RSS feed metadata, if you use that plugin, but that's already a bit far fetched.
- etimberg 7y agoI checked my own site which is built with Hugo and that's what it uses <meta name="generator" content="Hugo 0.56.3">
- nickjj 7y agoI added this to my RSS feed: <generator>Jekyll v{{ jekyll.version }}</generator> But it's optional.
- naniwaduni 7y agoOnly 22% did have any static site generator detected. Beyond that, 33% had a CMS detected. That leaves nearly half of analyzed sites as unknowns! Speculation aside on what might be effective aside, the real answer wrt OP is basically "it wasn't".
- jefftk 7y agoI generate my blog with a static site generator I wrote, but I don't see how anyone would be able to tell by inspecting the output. A heuristic that might work would be to add a cachebuster query parameter to the page url (?cb=$RANDOM) and see how long it takes to respond. The idea is that the three most common setups are: * static site served with apache/nginx/etc, which will just ignore the query param * dynamic site, which will regenerate the page * dynamic site behind a cache where the cache doesn't know that the query parameter isn't needed, and so the cachebuster will cause the page to be regenerated
- stevekemp 7y agoLooks like the link to the CSV file is broken, which is a shame.
- dewey 7y agoI think I can spot my blog in the Analytics section, I guess I'm the only one using Gauges as analytics.
- jacquesm 7y agoYep. That came from annoying.technology
- LolWolf 7y agoYeah I can spot my blog as the only Pelican user as well, oops.
- qznc 7y agoHehe. My blog falls through every statistic: No tracking and self made generator.
- spalas 7y agoHa -- I'm one of the 4 hosted with Caddy web server! All of my other attributes were in the majority (Hugo, Google Analytics, etc...)
- k__ 7y agoI would have thought that more blogs were on dev.to than these technology analytics suggest. Their stack is Rails+Preact.
- Anwarasseef 7y agoLink to the raw file is broken - Try this http://dannysalzman.com/files/hn-blogs.csv http://dannysalzman.com/files/hn-blogs.csv
- kristianc 7y agoInteresting to see the high numbers for GA. A bit of ‘do as I say, not as I do’ going on?
- pcr910303 7y agoProbably because there isn’t a good free analytics service that is easy to use (no need for self-hosting) and is able to collect the info that one wants. GA is free, and easy.
- arbol 7y agoPiwik is free and does everything GA does. You can self host the analytics dashboard so no 3rd party privacy issues.
- deleted 7y ago[deleted]
- seanwilson 7y agoSelf hosting is about as far from easy as you can get though.
- floatingatoll 7y ago“User privacy is only great so long as it’s effortless for the site operator”?
- oefrha 7y agoEvery time I see a privacy outrage thread over here I think about how many readers/commenters on this site work for advertising/tracking companies or companies whose products include tracking code. (Full disclosure: I don’t.)
- remus 7y agoAnd the number of readers who just aren't that bothered (and are even less bothered about getting in to an argument on the internet about it).
- jacquesm 7y agoOf those who responded to the 'what is your blog and why should I read it' thread. HN is large. Likely larger than many of its visitors realize because the participants are a relatively small fraction of the readership. So HN readers are not necessarily contributors. And not all contributors would plug their blogs in a thread asking them to do so. If you want to get an idea of the HN readership rather than of the HN contributors you may want to start off by scraping all the profile pages instead, it will give you a much larger set of sample data to work with.
- goatinaboat 7y agoAnd not all contributors would plug their blogs in a thread asking them to do so. Exactly. On a pseudanonymous forum that’s as good as asking people to doxx themselves!
- bovermyer 7y agoThere is a difference between acknowledging publicly who you are and doxxing, which I consider to be publicly releasing your phone number and physical address (at least).
- DoreenMichele 7y agoIf you participate under a handle here and use your real name on your blog, it may effectively amount to the same thing. People can have a variety of personal concerns, from a nutcase stalker ex to "I work for BigCo and want to spout off online without getting fired" to "I happen to have some bizarrely unique name, so using my real name anywhere amounts to doxxing myself." Lots of people on HN use a throwaway email just for HN and don't want general HN readership to know much about their lives. People use a wide variety of approaches to having an online life while looking out for their own specific privacy concerns. Please note that most people with privacy concerns will not chime in to this discussion to explain to you why they make the specific choices they make as that would tend to be counterproductive and undermine their goals of protecting their privacy.
- 7y ago
- jacobpake 7y agoIt would be interesting, in a future part of this series, to cross-reference the performance data with the technology used.
- mshafer 7y agoThat’s a helpful list of Google Analytics alternatives to check out, thanks! There are 13 websites using Parse.ly, which starts at $500 per month! For a personal blog??
- jacquesm 7y agoThe vast bulk of those are medium sites, possibly a volume deal with medium? http://robotoverlordmanual.com/ http://robotoverlordmanual.com/ https://medium.com/@andzwa https://medium.com/@andzwa https://medium.com/build-ideas https://medium.com/build-ideas https://medium.com/chrismarshallny https://medium.com/chrismarshallny https://medium.com/ing-blog/tech/home https://medium.com/ing-blog/tech/home https://medium.com/@matthagy https://medium.com/@matthagy https://medium.com/modern-nlp https://medium.com/modern-nlp https://medium.com/open-factory https://medium.com/open-factory https://medium.com/@romanorac https://medium.com/@romanorac https://medium.com/@soatok https://medium.com/@soatok https://medium.com/@zakjan https://medium.com/@zakjan https://sidstechcafe.com/ https://sidstechcafe.com/ https://vladaionescu.com/ https://vladaionescu.com/
- stared 7y agoI like the analysis. However, I am curious why entries are not sorted by counts. As a rule of thumb, sorting alphabetically makes no sense! Also, 382 sounds like a very small number, given the size of HN. I did try to find many blogs I read, but couldn't find one. So, crucially - was it a random sample? Or sample from top-liked, or from a particular month? some findings (e.g. the prevalence of Wordpress) may depend on this procedure.
- jacquesm 7y agoAt the top he writes how he got the data, from the 'what is your blog and why should I read it' post.
- stared 7y agoI missed that thing, without clicking the link. (I understood it was an inspiration rather than "Analysis of self-posted blog post to thread X".)
- input_sh 7y agoWhen I've seen the thread, it had like 500 comments. My comment wouldn't make a blimp and like five people would have seen it, so I just didn't post it.
- dsalzman 7y agoThanks for the advice! I went in and sorted the tables. I love Markdown for its simplicity and forces me to focus on the content, but sometimes simple things like sorting a table are a pain. Such is life.
- ereyes01 7y agoWhat does the "Programming Languages" section mean? Blogs that discuss the languages? Use the languages in snippets within posts?
- input_sh 7y agoI'm assuming the programming languages that CMSs people are using are written in, hence the dominance of PHP and Node.js.
- mnemnc 7y agoI‘m surprised and a bit disappointed that only 4 of them use Matomo. I assumed this to be the quasi standard alternative to Google...
- tiborsaas 7y agoIt's not an alternative if it's not free.
- jotm 7y agoThe self-hosted version is free.
- Carpetsmoker 7y agoWhen I announced my own analytics thing here a few months ago I got quite a few signups from the HN thread, and based on the bug reports, support requests, etc quite a few of the users are just running it on their personal blog. I'm aware of some other solutions as well that aren't mentioned at all in that table. Personally I found Matomo rather hard to use, I tried it for a while but decided that writing my own was easier than figuring out to get Matomo to do what I want (also: cheaper and easier). I think it's a good alternative for some use cases, but far from all. Related comment I left on Lobsters a few days ago: https://lobste.rs/s/cdrrty/why_you_should_stop_using_google#c_7kdfuq https://lobste.rs/s/cdrrty/why_you_should_stop_using_google#...
- WilliamEdward 7y agoIt's just a blog, matomo is more common in production.
- forrestthewoods 7y agoI looked into Matomo. Too much work. My blog is a hobbyist blog. I’m not maintaining a server for the next 30 years for my stats.
- vector_spaces 7y agoI suspect that the larger-than-one-might-expect representation here for Erlang and Cowboy (an Erlang web server) is caused by sites hosted on Heroku, which would return Cowboy/Vegur in the Server header, rather than because many HN users are actually maintaining Erlang application servers to serve their blogs.
- 40four 7y agoInteresting, I didn’t know Heroku used that stuff. It could be from Elixir/ Phoenix websites right?
- manimaran123 7y agoThank you for taking the time to provide us with your valuable information. We strive to provide our candidates with excellent care http://chennaitraining.in/sap-mm-training-in-chennai/ http://chennaitraining.in/sap-mm-training-in-chennai/ http://chennaitraining.in/sap-sd-training-in-chennai/ http://chennaitraining.in/sap-sd-training-in-chennai/ http://chennaitraining.in/sap-hana-training-in-chennai/ http://chennaitraining.in/sap-hana-training-in-chennai/ http://chennaitraining.in/sap-bo-training-in-chennai/ http://chennaitraining.in/sap-bo-training-in-chennai/
- manimaran123 7y agoGreat blog !It is best company for online job support from India http://onlinejobsupport.net/job-support/openspan-online-job-support/ http://onlinejobsupport.net/job-support/openspan-online-job-... http://onlinejobsupport.net/job-support/uipath-online-job-support/ http://onlinejobsupport.net/job-support/uipath-online-job-su... http://onlinejobsupport.net/job-support/automation-anywhere-online-job-support/ http://onlinejobsupport.net/job-support/automation-anywhere-... http://onlinejobsupport.net/job-support/salesforce-admin-online-job-support/ http://onlinejobsupport.net/job-support/salesforce-admin-onl... http://onlinejobsupport.net/job-support/microsoft-azure-online-job-support/ http://onlinejobsupport.net/job-support/microsoft-azure-onli... http://onlinejobsupport.net/job-support/data-science-online-job-support/ http://onlinejobsupport.net/job-support/data-science-online-... http://onlinejobsupport.net/job-support/machine-learning-online-job-support/ http://onlinejobsupport.net/job-support/machine-learning-onl...
- jamieweb 7y agoIt would also be interesting to analyse the domain name registrars and DNS hosting providers used. Based on my experience with the HN crowd, I'd predict that Gandi + Cloudflare would be a common one, with NameCheap closely behind.
- foxhop 7y agoI missed the original HN post, added my comment to the thread. Great work on the analysis.
- kickscondor 7y agoIf you’re interested in more about what these blogs contain, I review the links in all these threads at https://kickscondor.com/hrefhunt/ https://kickscondor.com/hrefhunt/. For example, here’s one from last year’s thread at this time: https://www.kickscondor.com/hrefhunt/6/ https://www.kickscondor.com/hrefhunt/6/
- dmvaldman 6y ago[off topic] FYI, i found this comment by subscribing to the RSS feed of your HN comments on Fraidycat (by linking to https://edavis.github.io/hnrss/ https://edavis.github.io/hnrss/ for your username) Very cool!
- kickscondor 6y agoOh hey - just saw this. Thank you for this link - I’ve been looking for just such a thing!
- stblack 7y agoIt's interesting, and telling, that Windows/IIS doesn't appear at all. Or did I miss something?
- ComputerGuru 7y agoWe run all our website on ASP.NET Core, but we have a forum and blog which basically automatically mandate MySQL. We played around with PHP on IIS [0] for many years before giving up. We also tried the opposite and hosted our app on Mono before giving up on that due to bugs that would randomly cause compilation errors [1]. Long story short, two completely separate backends each running on most reliable platform for the stack. And nginx is in front of it all. Ping the root domain and you’ll think you are on a big-standard Linux/nginx confit, even though it definitely is not. So don’t assume no IIS! [0]: https://neosmart.net/blog/s=php+iis https://neosmart.net/blog/s=php+iis [1]: https://neosmart.net/blog/tag/mono/ https://neosmart.net/blog/tag/mono/
- thanksforfish 7y ago> ended up copy and pasting all of the text from the entire post and then using regex on the command line to spit out a list of URLS. I had a chuckle. This is how so much data analysis happens in practice. Nothing like the command line for quickly cleaning some data. Great work!
- deleted 7y ago[deleted]
- xwdv 7y agoI would like to see a word frequency count gathered from all the articles written on all these blogs and see if there’s any interesting patterns. Bonus if you can segment the data by date as well so we can see trends over time. A person that builds such a system would have access to some pretty useful data.
- djhworld 7y agoNot sure if I added my blog late to that thread but it's not in the dataset. Granted there were a lot of URLs in that post!
- BigBalli 7y agoThank you for putting this together! Surprising insights: many actually use Google AdSense, nginx over apache I'd definitely be curious in: PageSpeedInsight (score, load time and size), post frequency/length past 12months, external link density
- BigBalli 7y agoI answered some of my own questions: "time": { "minTime": 0.7, "maxTime": 53.5, "meanTime": 5.5, "medianTime": 3.1 } "size": { "minSize": 1, "maxSize": 33484, "meanSize": 1536, "medianSize": 1565 }
- bobbydreamer 7y agoNice work.
- forrestthewoods 7y agoNeat. Here’s my blog if you do another run. https://www.forrestthewoods.com/blog/ https://www.forrestthewoods.com/blog/ It’s artisanally hand crafted HTML with a little VanillaJS on a few pages. No static generator used. Also hosted on Netlify. Although I use BunnyCDN for large media. I post very infrequently.
- shortformblog 7y agoOne interesting thing that this didn’t catch was my CMS, Craft—which I think is a signifier that Craft didn’t leave a lot of fingerprints.