5 ms·
Shopping Cart Redesign Boosted Software Sales 94% in A/B Test
- patio11 18y agoThought you guys would like to hear an update. Short version: the new cart appears to be working spectacularly well. Long version: see submission link. Original HN thread: http://news.ycombinator.com/item?id=477233 http://news.ycombinator.com/item?id=477233
- Harkins 18y agoI know I did. Thanks so much for writing these great "What I did and how it worked for me" posts with such detail, I really enjoy seeing how other entrepreneurs have gone about their businesses.
- bprater 18y agoMe, too. And congratulations -- finding a 100% increase lurking on your site is pretty huge. I hope you find more. And make sure you let us know about 'em!
- patio11 18y agoYou may be interested by my blog (see profile), which is essentially 2.5 years of "I did X and got a 2%, 5%, 25% lift" or "I did Y -- sucked, reverted". Granted, most of them are not in nearly so much detail and when I was starting out my approach lacked rigor. Heck, it still does in a lot of ways. Some random notes: 1) Linking non-technical users to an image file is like asking them to please leave your site. Since I had a prominent image on the front page, replacing the direct link with a lightbox resulted in about 10% decrease in bounce rates. 2) I used to use quiet, understated buttons in my sidebars and on my download page. My friends derided them as "big pancake buttons" when I started, and it has sort of become my design trademark: they're now MUCH bigger. (I think the ideal size is about 800x600 but I've never been quite brave enough to test.) +25% conversions. 3) The first textual link in copy gets clicked on more than any other textual link in the page. Make sure it leads to a high value page (in my case, download free trial) rather than a low value page (in my case, screenshots -- I think, its been a while). 4) I just learned this two weeks ago: if you have copy which takes up impressive vertical space with a button at the top and a button at the bottom for God's sake put a button at appropriate points in the middle. +10%
- rs 18y agowell done! Would be great if you could post an update at the end of this month, and see if you really had to rescale the Y-axis ! :)
- patio11 18y agoThere's a link in there to my automatically updated sales data. It rescales automatically. Feel free to submit that page if you want, I try to keep bragging to a dull roar. ;)
- sam_in_nyc 18y agoWhat happens when I set my own price? http://www.e-junkie.com/ecom/gb.php?i=patio11-001&c=single&cl=1807&quantity=1&amount=5.00 http://www.e-junkie.com/ecom/gb.php?i=patio11-001&c=sing...
- goodkarma 18y agoThis was great reading. I've put off A/B testing with Google Website Optimizer long enough. Looking forward to boosting my revenue! ;-)
- ars 18y agoExecutive summary: Old cart: Opens new page, standard cart design. New cart: Lightbox style (gray out the background, box in the middle), ajax shopping cart.
- patio11 18y agoActually: Really old way I did things: No cart at all, used matrix of buy-it-now buttons. Old cart: Lightbox style (gray out the background, box in the middle), ajax shopping cart which takes two seconds to open and is a little cluttered in some use cases. Beats above option by lots. New cart: Lightbox, feels-like-AJAX (everything is pre-loaded so that opening a new DIV or recalculating prices is essentially instantaneous -- no HTTP request involved), instantaneous response and no clutter. Beats old cart by lots.
- ars 18y agoI am so used to loosing my place when clicking links, that I routinely middle click them to open new tabs - this includes add to cart links. So I would never discover this new box on my own on your page. (Since middle clicking just takes you to the old cart.) Ideally you'd want middle click to take you right back where you came from, but with the ajax cart pre-opened. Am I so unusual? Every person I show the "middle click open tab in background" to gets hooked, and now that's the only way they browse.
- nazgulnarsil 18y agono, I introduce people to it and they all get hooked too. no more time wasted waiting for pages to load. ctrl + click does the same thing, and ctrl + shift + t opens the last tab you closed.
- joepestro 18y agoI do this too. One possibility would be to send the product id in the link's url, then display the product in a lightbox on the new tab.
- patio11 18y agoYou may or may not be usual, but you are certainly not a usual elementary school English teacher. I could show you an old heatmap of my front page which had a non-interactive screenshot of the program. There is a BIG RED DOT on the print button in the screenshot. My customers are not middle clickers.
- c3o 18y agoInteresting... congrats on the increased sales. One thing I was a bit confused about: You say you want people to easily be able to continue browsing your marketing copy before committing to buy. But how do they get back to the cart once they've closed the lightbox? Clicking the buy button again reveals just one item in the cart. So in essence closing the lightbox means "discard this cart" rather than "continue shopping", right? That means your findings only work for pages that have one single item for sale (or items similar enough that buyers only want to purchase one of them, as in your case). Your sample size is also quite low (94% increase = from 8 conversions to 15), and you're using absolute values in the graphs. Did traffic to the page stay constant over all that time?
- patio11 18y agoThank you. In my entire existence as a business I have never seen someone by X licenses plus Y [license plus CDs], and indeed even explaining the difference to my customers would be tricky. So I opted to make it impossible -- if you ask for 5 copies of the software via download you get five copies, if you then ask for the CD instead it will set you up for 5 copies and 5 CDs. The cart actually remembers everything that you've put into it within the current page, even if you close the lightbox. If I wanted to save it there are options but a) dirty hack and b) most of my customers have no need for it. Your sample size is also quite low (94% increase = from 8 conversions to 15), and you're using absolute values in the graphs. Did traffic to the page stay constant over all that time? That last question appears to demonstrate a misconception about A/B tests. I did not test the old cart serially with the new cart -- I've done that sort of thing before, but the results are automatically suspect because factors other than the variable you're testing are constantly changing. An A/B test tests the old cart and the new cart at the same time -- when you open purchasing.htm Google flips a coin and cookies you up with the results. Heads you get the old cart. Tails you get the new cart. No matter how many times you go back you get the same cart (until I terminate the test, obviously). This means that I'm able to have confidence in the results despite this week having traffic far above my typical values, due to Valentine's Day. (Certain holidays are almost always good to me. Why is outside the scope of this post.) The sample size was not 8 or 15, incidentally. It was two groups of over a hundred (prospects, not customers). While I'd prefer groups of over a thousand for the obvious reason that it implies I'd sell ten times more software, in stats terms that doesn't make the experiment more valid, it would just decrease the size of the confidence intervals by roughly a factor of sqrt(10), and it might also increase the confidence in the significance test (that was the second 94% value, see the writeup).