Like others have said try to keep your A/B tests the same except for the one change you are testing. If you haven't already check out patio11's book. https://

Like others have said try to keep your A/B tests the same except for the one change you are testing. If you haven't already check out patio11's book. https://www.kalzumeus.com/2012/12/21/i-wrote-a-book-on-conversion-optimization-for-software-companies/ https://www.kalzumeus.com/2012/12/21/i-wrote-a-book-on-conve... It still has lots of great info. His block, podcasts and comments here on HN are worth checking out too.