8 ms·
Can a Puppy Sell a CMS?
- svmegatron 13y agoIn my experience "image beats text" is a really common result of an AB test. For an encore, I'd suggest testing an image of a (smiling) person in that same space.
- malcolmmcc 13y agoWorth testing, but in my experience stock photos of people make websites look cheesy and fake. Untrustworthy, even. Like one of those fake sites to gather extra domain traffic.
- svmegatron 13y agoVery good point. OP, be wary of stock photos, especially if the model is wearing one of those asinine phone-headsets.
- bobfunk 13y agoGreat suggestion - would be interesting to put a smiling person against the doggy
- Anonymous09 13y agoAnother advantage of the dog is how it's looking to the right. After your eyes dart to the puppy, you naturally follow it's line of sight to see what it's looking at, and you end up at the sign up button. If they use an image of a person, they would need to be glancing or gesturing in that direction as well. Actually, I'd like to see them A/B test the puppy against itself, but flip it horizontally so it's looking to the left in one scenario.
- rubinelli 13y agoIs that the sound of a thousand startups adding puppies to their homepages instead of running proper A/B tests?
- willismichael 13y agoYes, yes it is. The question remains as to whether there is a small number of stock puppy photos that will end up being used by the majority :)
- outworlder 13y agoJust use pugs. http://pugbomb.me/ http://pugbomb.me/
- elliottcarlson 13y agoAt one point in my career I had two job offers on the table - my wife was helping me decide, and when she saw that one of the companies had a dog on their site, she said I had to work for them. In the end, I did accept that job offer for my own reasons - but it's interesting how the emotional response is to the cuteness factor. Coincidently I now work at a company with currently 4 dogs in the office.
- hjay 13y agoIt's interesting you mention that. I remember just a month ago, seeing pictures of dogs in the offices at Palantir (on their website), and wondered if seeing that became the deciding factor for prospective employees.
- fuzzix 13y ago"Coincidently I now work at a company with currently 4 dogs in the office" Jesus, and I complain about how hard it is to concentrate in a noisy open plan office. A bunch of non-human animals roaming about might just tip me over the edge.
- psionski 13y agoAt least where I worked, the dog just kept us company and wasn't obnoxious at all. It was very calming to just play with her when you're stuck somewhere, most of the time petting the dog yielded beautiful technical solutions. She should have been on the payroll (well, she did get snacks, but was worth way more than that IMHO).
- elliottcarlson 13y agoI was concerned about this at first - but overall it's really great. There have obviously been a few altercations between them, but those are rare. One of the dogs is owned by a member of my team so he sits right by me all day - occasionally he'll come by just to be pet, and when I am stuck on something work related we play fetch for a few minutes to clear my head. Our daily standups are pretty awesome too since we generally have a dog or two there with us, for example, yesterdays standup: http://i.imgur.com/3DABSti.jpg http://i.imgur.com/3DABSti.jpg
- jschuur 13y agoWould be interesting to see puppy vs kitten results.
- motyard 13y agome too. +1
- peterwwillis 13y agohttp://en.wikipedia.org/wiki/Advertising http://en.wikipedia.org/wiki/Advertising (to elaborate for the downvote-debbies: there is an entire industry designed around getting users to use your product based on ideas such as this, and this link is one place to learn more about that)
- tixocloud 13y agoWe learnt about this in marketing class. If you're feeling lazy about getting creative, use cute animals.
- wyck 13y agoPretty much this, that's why most TV ads have animals and many huge corporations base their entire brand around them. What's next someone telling us they increased conversions because they used photo's of smiling people? /debbiedowner
- pnathan 13y agoNot to be throw rocks at github(because they are awesome!), but Octocat fits the bill. - Cute - Mascot - Original - In-joke-ish (octopus merges, the internet is for cats)
- hjay 13y agoI'd like to see tests between that dog, and a person, or a group of people. Having images generally will help with conversion rates, but what kind of images would produce a better result? And for what kind of services?
- kamakazizuru 13y agoi wonder if it simply has to do with the fact that there was AN image there ? Maybe verify by putting something not as cute - say an ORC or something like that? and something neutral like a fruit?
- dkuntz2 13y agoBut was it really the puppy? There was a lot more text explaining what was involved (okay, not all that much, because there wasn't a lot on either, but significantly more) on the puppy version. It could just have been that you described what signing up entailed. Plus you included 'cancel at any time', which might help some people decide.
- hcarvalhoalves 13y agoThis lacks a control test: a version with any image. Just the fact you used a graphic can make it superior to the text version, not necessarily because it's a dog.
- aaronjg 13y agoFirst of all, great work. It looks like you boosted your conversion rate from 0.19% to 0.43%. Which is a 125% improvement, or with confidence intervals, 55% - 179% improvement. However, before everybody goes out and puts puppies on their homepages, they need to realize that there are a bunch of things being tested. Image vs. no image: Is it possible that having any image at all improves the conversion. You should test with other pictures: perhaps some animals, people, nature, and see if the puppy is what makes it work. Call to action: The 'puppy' version also features a more succinct call to action in "Sign up now" rather than "Start your 30 days free trial." Perhaps this also contributes some of the difference. Button size: The button size in the 'puppy' version is smaller. Perhaps this has some effect as well. Length of text: The 'puppy' version has more description of what is involved in the free trial. It says "Pick a plan & sign up in 60 seconds. Upgrade, downgrade cancel at any time." vs. the no puppy version that says "Start you 30 days free trial." Vertical vs. Horizontal Layout: The 'puppy' version has a vertical layout of the text and button, where they are stacked on top of each other rather than left or right. So there are at least five different changes made between these two designs. Clearly the second design wins on conversions, but it's not entirely clear to me why it wins.
- SeanDav 13y agoNot sure how you can get much of value from an A/B test with multiple changes, especially if one is claiming that only 1 of those changes is what is responsible for all the improvement.
- nathanfp 13y agoYou can iterate on the other tests over time. Many A/B tests start with a larger change that may include multiple variables but with that baseline increase, now they can go ahead and test Dog vs Cat vs Human as the image. Or can test a variety of different text sizes and lengths. This seems like a fantastic start, with plenty of room for further iteration and improvement.
- harlanlewis 13y agoIf nothing else, they have a hypothesis to test in the next experiment. Even when possible to isolate and remove ancillary changes to improve split test purity, it's often not beneficial. If there's a significant number of changes, achieving statistical significance across the full matrix probably isn't even possible. But that's ok, because limiting changes to a single test queue restricts your ability to move fast and try lots of stuff, which is beneficial. So when you test, try cheap multivariate methods (there's a bunch!) to quickly understand how interactions between multiple changes affect results.
- terrellm 13y agoThe article title gives the puppy image credit but I think the additional text had as much if not more of an impact on the conversion lift than the image. "Start your 30 days free trial" text vs "*Sign up now* 30 days free rial. Pick a plan & sign up in 60 seconds. Upgrade, downgrade, cancel at any time." with a puppy image. The second version is so much better because it tells the viewer what to expect... the 60 second signup, flexibility in changing plans, no long-term commitments. The dog image does help since he is looking at the call-to-action, which also draws the viewer's eyes there too. It is a great post and just goes to show how testing can really help boost conversion. It's often a lot cheaper to grow your business by improving conversion rates than by increasing traffic.
- mbesto 13y agoTotally agree. The OP wrote: "But we can still be fairly confident that the image was the main factor since this test had a much higher change in click through than what we typically see when we just test text vs text." How can you be fairly confident? They broke the cardinal rule of the scientific method.
- skrebbel 13y ago> How can you be fairly confident? Come on. It's a puppy. A puppy!
- bobfunk 13y agoWell, it's worth noting that while we're interested in the general science of puppies and conversions, our end goal with this test was not to determine the exact value of the puppy picture, but just generally finding the best way to get people to click our call to action button...
- herbig 13y agoBut how do you determine the best way by introducing multiple variables into your experiment? The best way may be with the puppy or without. From this you have no idea.
- Samuel_Michon 13y agoMore people clicked through to the sign-up page, but did the actual number of sign-ups increase too? After all, in the end, that's what matters. If people click your link just because they want to see more pictures of puppies, it might not be such a great improvement.
- davidroberts 13y agoEmotions do sell things. I like to think of myself as a rational person, but it certainly works on me. For example, when I was living in Japan around 1996, we needed a kerosene heater for our apartment. We went to the big department store, and they had a lot of different ones. Each of them had a sticker affixed describing the various features and advantages, but they were mind-numbingly similar. But one of the stickers had a photo of Mai-chan, the cheerful and engaging child star of a cooking show that we had enjoyed on Japanese TV a couple years earlier. My wife pointed it out to me, and we ended up getting that heater. Not because it was any better, but because we liked Mai-chan, and her photo was on it. Of course Mai-chan has absolutely nothing to do with heaters, and we knew it. But we didn't care. We always called it the "Mai-chan" heater, and even though we left it behind when we returned to the states, I guarantee if I mention the Mai-chan heater to my wife today, nearly 20 years later, she'll smile and know exactly what I'm talking about. The puppy screenshot in the original post has a similar effect on me. A part of me wants to reach out and pat the cute dog on the head. But I can't. But I can click the button, which is what he obviously wants me to do. Sure it's not at all rational. But it motivates people. I suggest keeping the dog and adding it all your advertising. Make it your mascot. You can't go very wrong with a puppy!
- craze3 13y agoI suggest keeping the dog and adding it all your advertising. Make it your mascot. That's exactly what I imagined when I saw the title; a startup testing/comparing the conversion rates of a dog mascot/logo. It goes hand-in-hand with establishing a memorable brand. I'd be really curious to see how the conversion rates are affected by a complete website/brand overhaul containing a dog mascot.
- guptaneil 13y agoNot a dog, but my startup (tabuleapp.com) added a koala as our mascot, and our conversion rates more than doubled. We help college students organize homework, so the fun koala face helped differentiate us from most homework planners that just use a book as their logo.
- kailuowang 13y agoWe all know that puppies can sell CMSs. That's a given. What they should A/B test is the effectiveness between a black lab and golden retriever. Joking aside, the text version has no picture at all (could be just that screenshot), one thing I haven't forgotten from my marketing 101 is that pictures grab attention 10X better than text.
- bluedino 13y ago> the effectiveness between a black lab and golden retriever. Good call. Aren't black dogs the least likely to be adopted from shelters?
- goronbjorn 13y agoThe lead designer at Mailchimp wrote a really good book on this subject (designing for emotion): http://www.abookapart.com/products/designing-for-emotion http://www.abookapart.com/products/designing-for-emotion
- felipebueno 13y agoThis reminds me of Windows Bob but I don't think it worked very well for Microsoft putting that dog there. Initially people (women and children) were impressed with how cute it was but five minutes later they were trying to kill that annoying yellow dog.
- callahad 13y agoNewsblur also employs a puppy on the sales page: http://grab.by/lIYE http://grab.by/lIYE
- instakill 13y agoThe change is more than just adding an image of a puppy: You added an image, period. You also changed the CTA button style. The split-test did not test an independent variable. Having said that, it's good that your conversion went up.
- Kylekramer 13y ago"People like puppies" seem to be Rogers subsidiary Fido's business plan in a nutshell.
- aw3c2 13y agoIt says "the number of clicks on the signup button" was measured. That does not seem like the metric they are interested in which would be "number of actual signups".
- tankbot 13y agoIf a puppy can sell a CMS, what about a Hippster Cheetah?[0] [0] http://www.extensis.com/ http://www.extensis.com/
- chenster 13y agoFrom KISSMETRICS, color is also a major factor in buying decision. http://blog.kissmetrics.com/color-psychology/ http://blog.kissmetrics.com/color-psychology/ The most popular color? Blue! IBM is blue, now Windows Blue, Mac OS X aqua blue... you name it.
- orangethirty 13y agoYes, dogs do sell. I've used: - babies (various poses, ages) - tools (wrenches, screwdrivers, axes, etc) - clothing - auto parts - aliens (as in fake grey aliens) - people in weird situations - women crying (this one works well near saint valentines) - an animal with a cast (better yet if its a small bird) - toilet paper (a new roll. not used) - random charts (pie, bar, etc.)(The charts doesnt even need to make sense) - a lock (big master lock) - and one time I ran an alpaca. Weirdly, it converted better than anything else. Don't ask.
- IanDrake 13y ago- aliens (as in fake grey aliens) I wonder how well real aliens would do.
- orangethirty 13y agoI meant fake looking. Not some realistic image. Still, I'd like to test a real alien, too. (:
- Groxx 13y agohow recent was this alpaca run? it's kind of a thing lately. also: http://firealpaca.com/en http://firealpaca.com/en did you try adding a bowtie?
- orangethirty 13y agoNovember 2012. The headline was something along the lines of "If X does not fix Y, our Alpaca leave you a voicemail." It improved conversion by about 20% (image vs no image). Same headline.
- krichman 13y agoThis sounds like a lot of fun. I wish I had an amount of visitors to make A/B testing viable. Maybe in a few months.
- orangethirty 13y ago
- jguimont 13y agoThe whole marketing of the cellular company is based on puppy: http://www.fido.ca/ http://www.fido.ca/
- sadkingbilly 13y agoIt's not the puppy. People used to game Google Adsense by putting their own images next to the adsense blocks in order to get more clicks. MFA sites did this so much, Google banned the practice of using images next to their ads. This is the same result.
- emackn 13y agoOf course, look how much traction Drupal has gotten from a raving water droplet .
- jostmey 13y agoSUMMARY OF ARTICLE: Question: Is a skillfully designed bug-free easy to use CMS package more important than a picture of a puppy? Answer: The picture of the puppy is clearly more important.
- mosselman 13y agoYou changed the text, thus ruining the results, or at least, making them worthless with respects to measuring the success rate of the puppy.
- abeh 13y agoIt's a nice test. However, I'd like to see how many of each group stay after the 30 day trial.
- SmeelBe 13y agoVery interesting result, 100% more signups. Try now with a cat.