3 ms·
good advice! From working on an internal a/b testing platform, we had built-in tooling to do some of this stuff after the fact. I don't know of any off-the-shel
by withinboredom 2y ago
good advice! From working on an internal a/b testing platform, we had built-in tooling to do some of this stuff after the fact. I don't know of any off-the-shelf a/b testing tool that can do this stuff.
- alvarlagerlof 2y agoPretty sure that http://statsig.com http://statsig.com can
- ulf-77723 2y agoWorked at an A/B Test SaaS company as a solutions engineer and to my knowledge every vendor is capable of delivering solutions for those problems. Some advertise with those things, but the big ones take it for granted. Usually before a test will be developed the project manager will assist in mentioning critical questions about the test setup
- chashmataklu 2y agoPretty sure most don't. Most A/B Test SAAS vendors cater to lightweight clickstream optimization, which is why they don't have features like Stratified Sampling. Internal systems are lightyears ahead of most SAAS vendors.
- brocklum 2y agoI work at Statsig and we built it recently: https://statsig.com/updates/update/stratified-sampling https://statsig.com/updates/update/stratified-sampling. Definitely still some internal systems that are way ahead of SaaS but we're seeing more companies ditch internal builds for us.