4 ms·

Are you A/B testing?

• gfodor 13y ago
  Depending on how many users this app has, A/B testing may not be possible. After working for a larger company that had lots of traffic, I started to take it for granted that I could run an experiment for a day and get an answer. When bootstrapping a new product, you just have to throw stuff at the wall based on intuition (and customer development) and hope something clicks so you can get that stream of traffic to A/B test with.
  • orangethirty 13y ago
    You can run very small tests, though. They will not scale, but will give some insight into what the current user base prefers.
    • gfodor 13y ago
      That all depends if you can get statistical significance. The catch-22 here is that the only way to really get statistical significance without a lot of data is to have a clear winner, which would have probably jumped out as a better solution regardless of how rigorous your testing methodology is. The worst thing you can do is run a test and jump to conclusions based upon limited data.