3 ms·
The team uses them. Outside of looking for bugs I still have not been convinced that it is useful to check if blue versus green button has useful conversion rat
by NikolaeVarius 5y ago
The team uses them. Outside of looking for bugs I still have not been convinced that it is useful to check if blue versus green button has useful conversion rates.
- capableweb 5y agoThat's A/B testing, not feature flags. Check https://news.ycombinator.com/item?id=30115276 https://news.ycombinator.com/item?id=30115276 for a description of how feature flags are used.
- the-alt-one 5y agoA/B testing can be done with feature flags. Gradual rollout, specific customer opt-in, and so on.
- capableweb 5y agoI guess you could do A/B testing with feature flags but honestly, it won't be any good. If you want a good answer if to go with A or B, you want to have many data points, not just from one specific customer. Gradual rollout and specific customer opt-in to certain features can certainly be done with feature flags, I wouldn't call that A/B testing unless you're running experiments and reaching a conclusion that A is better than B (or vice-versa).
- ampersandy 5y agoYou can totally implement A/B tests on top of a feature-flag framework. Your “pass” function should be hashed on the User ID/Cookie/whatever and then you can distribute users into pass/fail. You should do this anyway for reproducibility. If you log whether they passed/failed and then have metrics, you compute experimental results.