If you are going to A/B test in that manner or with Google Web-optimizer, you need to be aware of how your tests are setup. There needs to be a clear and measu

If you are going to A/B test in that manner or with Google Web-optimizer, you need to be aware of how your tests are setup. There needs to be a clear and measurable action such as a sale to determine success. However, this is only a piece of the puzzle for most online sites. There are many other goals such as user retention, enjoyment and approval. That A/B testing can be adequate for something like a sales page (37 signals testing was a good example), but falls short if you don't have clear measurable goals.