4 ms·
This is part of a planned series. See http://news.ycombinator.com/item?id=5112670 http://news.ycombinator.com/item?id=5112670 for the initial plan. This is pr
by btilly 14y ago
This is part of a planned series. See http://news.ycombinator.com/item?id=5112670 http://news.ycombinator.com/item?id=5112670 for the initial plan. This is probably the most important in the series, since it addresses a very practical and common problem. That plan likely will change - I've received a few random additional ideas, and I really think that at some point I should address the question of how much I've been giving up with the simplification of only looking at conversions. (Short version: depends on conversion rates. If absolute conversion rates are low, then not much. If conversion rates are high, then a more complex analysis is significantly better. But most websites have pretty low conversion rates so I haven't given up much.)
However I would not recommend holding your breath too eagerly for the next one. According to a back of the envelope calculation, the opportunity cost on each article has been about $4k for me. I think I know what I want to write, then I begin adding things, removing things, play around with extra simulations, decide to change subtle details, etc. I think I know what I want to write for the next one as well, but I said that the last two times. Therefore I should assume that the same thing will happen the next time.
I want to do this series. So it will happen eventually. But I can't afford to pump them out quickly.
- tel 14y agoI really love these articles. You're solving very practical problems with a depth of statistics that most people never appreciate. It's really great work. I'm sorry to hear that you feel the opportunity cost pain so severely. It might not be worth it to you in the larger scheme of things, but I think you could definitely package up and sell an expanded version of this series that spends more time elaborating the value proposition and provides some simplified decision processes for various common situations. More Fisher than Jaynes.
- hashtree 14y agoAgreed, I'd be in the market for such a book.
- btilly 14y agoFor me, the difficulty of writing goes up nonlinearly with the length of the thing that I am trying to write. If I told my wife that I was writing a book, she'd want to kill me. And I wouldn't blame her for that. This subject is particularly hard, because I'm trying to require as little background as possible, on a topic that normally requires much more.
- tel 14y agoI wouldn't think a book is necessary. A short "pamphlet" basically could be really great for (a) convincing people that statistics can be done more flexibly than they might think and (b) showing a number of case examples as to how to do it. The value of further published material might be improved by this kind of publication as well.
- gwern 14y ago> According to a back of the envelope calculation, the opportunity cost on each article has been about $4k for me. I think I know what I want to write, then I begin adding things, removing things, play around with extra simulations, decide to change subtle details, etc. Out of curiosity, is that rough guess with or without the value of everything you're learning in the second sentence?
- btilly 14y agoThat figure is based on, "Here is how much I didn't get paid that I could otherwise have expected to be paid by the contract that I let slide so that I could work on this article." So no, I'm not valuing my increase in knowledge. And am not valuing the publicity that these articles have received. (Though the fact that I have people ready to pay me for my time suggests that I don't need marketing at the moment.) It is a look at where my bank account stands right now relative to where it would have stood if I had not chosen to write these articles.
- gwern 14y agoAh. That's a reasonable way to calculate it.