3 ms·
You cannot control for lots of other externalities, such as inflation and competitors coming to market. These parameters will affect long-term users as well.
by dotancohen 4y ago
You cannot control for lots of other externalities, such as inflation and competitors coming to market. These parameters will affect long-term users as well.
- smachiz 4y agoisn't that why it's good? You can't control infinite variables, the only ones here are A/B and you're keeping a subset of them as a control group?
- dotancohen 4y agoI suppose that is a way of looking at it.
- bootsmann 4y agoWell presumably these externalities are independent of the variables you are changing so they should affect your hold-out set and your experiment sets equally.