4 ms·
This is the frightening reality of what happens when you have a large business where everything scales multiplicatively and then you make a trivial change which
by patio11 17y ago
This is the frightening reality of what happens when you have a large business where everything scales multiplicatively and then you make a trivial change which is net-beneficial. People want this to be impossible because it strikes you as intuitively wrong that five minutes of work could be worth eight figures. Reality doesn't care what you think, though.
Relatedly, and more prosaicly, if you average one successful A/B test with a 5% lift per month, and you do nothing else, your business will grow at about 80% per year. Multiplicatively effective businesses are a wonderful place to be in life.
Then I look over at Zynga at all where you can do multiplicative effectiveness within the context of a viral loop, which is just so effective I'm almost certain it goes against my religion somehow.
- fierarul 17y agoDon't take this the wrong way but on every comment I've read from you, there is "A/B" :-) Not sure how Zynga's effectivness might be against your religion, but "A/B" is part of you somehow: religiously or not.
- scorciapino 17y agotest
- MaysonL 17y agoA/B = the core of the scientific method.
- fierarul 17y agoNot so sure about that... It looks to me that A/B leads quite easily to a local optimum. But it's better than no method at all.
- axod 17y agoThat all sounds very deep for something I think it a lot simpler. 1. They tried some weird colors. Didn't work well 2. They thought "screw it" and copied the colors Google use. (Give or take) 3. Users feel more 'at home' and maybe even assume the results are from Google. You can't replicate that situation. You can't copy the colors Google uses again. I guess you can make Bing even more like Google, but only up to a point.
- chaosmachine 17y agoI suspect you're right on. The rest of this story is just some made-up huge number that would get people talking about Bing.
- OmarIsmail 17y agoAlso, this 'trivial' change isn't so trivial. The actual change itself is relatively minor, however the infrastructure required to perform proper testing, analysics, etc is huge. Not to say the the large number of users required to do proper testing quickly. These huge number of users are a result of decades of MS' brand, multi-million dollar marketing campaigns, etc etc. Kind of like how it takes a lifetime to be an overnight sensation.
- DaniFong 17y ago80% per year outpaces Moore's law, btw.
- nopassrecover 17y agoMoore's law isn't about business growth.
- DaniFong 17y agoNo, it's about growth, in general.
- nopassrecover 17y agoNo, it's about the number of transitors on an integrated circuit and the resulting computational power.
- DaniFong 17y agoIf one takes the narrow view, yes.
- naner 17y ago> if you average one successful A/B test with a 5% lift per month, and you do nothing else, your business will grow at about 80% per year. Aren't there too many variables? How do you know the increase isn't just a correlation?