5 ms·

Recently I deployed a new design for my web app that I thought was much better than the previous. A few of my users complained and I decided to rollback the ch

by aymeric 15y ago

Recently I deployed a new design for my web app that I thought was much better than the previous. A few of my users complained and I decided to rollback the changes. Nobody has complained about the rollback but I still believe the new design was better. I find it hard to know how to decide when to push further against the community sentiment. Facebook has done that countless times and it has worked for them. I guess this is where the founder's vision comes into play. How do you decide what to keep and what to ignore?

jakejake 15y ago
You have to figure out what feedback is meaningful and what feedback is merely change aversion. If the users have a valid point, then maybe consider reverting. If you believe it's just change aversion then you have to stick to your guns for the greater good. Just like you said with Facebook, people will gripe about every change. But they gradually will appreciate the improvements as they get used to them.
- joshuahedlund 15y ago
  This is a good point. Sometimes I definitely experience change aversion. But usually if I'm upset about a change it's because there was something that used to take one click that now takes three, or some kind of new complication or a feature that has been completely removed. It's even more frustrating to users if they make these kinds of points and you respond with "Change Aversion!" The trick is knowing the difference (or knowing when some complicated/removed features are worth overall UI improvements)
  - jakejake 15y ago
    Yea I know the feeling, I think if you remove a feature without providing any replacement then that can be tough on the users. Outright removal of features is something I try to avoid unless I felt like the software was moving in a directly that wasn't right. If something takes more clicks because it's a rarely used feature, that may be acceptable if the reason is to improve a more common feature that now requires less clicks. It's ultimately up to you to decide the direction you are going to take. If you really want a challenge, wait until you do an entirely new port or total concept change after people have been using your software for several years. They often get really cranky about that, even if the new software is miles better.
ChrisNorstrom 15y ago
Show us the redesign vs original design. The best way to tell if a design is "better" than the original is to put both version in front of brand new users who haven't developed usability habits yet. Sometimes when you make an app the first time, it's badly designed but people get used to the bad design. Then when you improve it they have to relearn everything and that's why they're pissed off. Another thing you can do is "incremental design". Change things little by little over time.
- kenrik 15y ago
  ^ This! My company had a website that predated Google (seriously) when we updated it you can imagine the shock people had after using the same site for like 14 years.Incremental design in this case was out of the question it had to be forced. They will get used to it soon enough. Remember the famous quote from Henry Ford: 'If I had asked people what they wanted, they would have said faster horses.' Change for changes sake is not good however there are times where you NEED to change and you have to face the criticism and stand your ground. The trick is to know the difference.
  - Wilduck 15y ago
    wundergound.com?
  - yarone 15y ago
    FYI - Henry Ford likely didn't say that (although I love the phrase): http://www.quora.com/Quotations/Did-Henry-Ford-actually-say-If-Id-asked-my-customers-what-they-wanted-theyd-have-said-a-faster-horse http://www.quora.com/Quotations/Did-Henry-Ford-actually-say-...
- loceng 15y ago
  For a good example of this, think Digg vs. Reddit
  - aymeric 15y ago
    Do you mean Digg has pushed a big design change and Reddit just does small changes (if any)?
powertower 15y ago
All change is unwelcome at first. It's unfamiliarity. You have to understand this or you'll fail every time. The way to get around this is to make gradual changes.
- aymeric 15y ago
  Surely some changes can be bad. Facebook Beacon was removed after some time for example. I'd like to know how to figure out what is the fastest to know if a change is for the better or the worse. In the case of design change, I wouldn't expect a direct change in the metrics, it would impact on a longer term though.
revorad 15y ago
If a vocal minority complain about the new design, but still carry on using the app then you probably don't need to worry. Look at the data.
- aymeric 15y ago
  What data would you look at for a in-app design change?
  - revorad 15y ago
    First, I'd just look at the simple overall engagement metrics that matter most to you. For example, if time spent on your web app is most important to you, then see how that was affected by your new design. You could compare the users who say they don't like the new design with the rest of the users. It's likely that some specific features or actions will be affected by a redesign, so track that using Mixpanel or something similar, and again compare old vs new behaviour and complaining users vs others. For example, did people stop clicking on some buttons after the redesign? Did they start buying much less?
JoachimSchipper 15y ago
A/B testing?
- aymeric 15y ago
  I think A/B testing would take too long to show the effect of the design change. Design helps your users like your app a little bit more and I think it would show in retention, but not in sign up conversion. What metric would you measure?

by aymeric 15y ago

jakejake 15y ago

You have to figure out what feedback is meaningful and what feedback is merely change aversion. If the users have a valid point, then maybe consider reverting. If you believe it's just change aversion then you have to stick to your guns for the greater good. Just like you said with Facebook, people will gripe about every change. But they gradually will appreciate the improvements as they get used to them.

joshuahedlund 15y ago
This is a good point. Sometimes I definitely experience change aversion. But usually if I'm upset about a change it's because there was something that used to take one click that now takes three, or some kind of new complication or a feature that has been completely removed. It's even more frustrating to users if they make these kinds of points and you respond with "Change Aversion!" The trick is knowing the difference (or knowing when some complicated/removed features are worth overall UI improvements)
- jakejake 15y ago
  Yea I know the feeling, I think if you remove a feature without providing any replacement then that can be tough on the users. Outright removal of features is something I try to avoid unless I felt like the software was moving in a directly that wasn't right. If something takes more clicks because it's a rarely used feature, that may be acceptable if the reason is to improve a more common feature that now requires less clicks. It's ultimately up to you to decide the direction you are going to take. If you really want a challenge, wait until you do an entirely new port or total concept change after people have been using your software for several years. They often get really cranky about that, even if the new software is miles better.

ChrisNorstrom 15y ago

Show us the redesign vs original design. The best way to tell if a design is "better" than the original is to put both version in front of brand new users who haven't developed usability habits yet. Sometimes when you make an app the first time, it's badly designed but people get used to the bad design. Then when you improve it they have to relearn everything and that's why they're pissed off. Another thing you can do is "incremental design". Change things little by little over time.

kenrik 15y ago
^ This! My company had a website that predated Google (seriously) when we updated it you can imagine the shock people had after using the same site for like 14 years.Incremental design in this case was out of the question it had to be forced. They will get used to it soon enough. Remember the famous quote from Henry Ford: 'If I had asked people what they wanted, they would have said faster horses.' Change for changes sake is not good however there are times where you NEED to change and you have to face the criticism and stand your ground. The trick is to know the difference.
- Wilduck 15y ago
  wundergound.com?
- yarone 15y ago
  FYI - Henry Ford likely didn't say that (although I love the phrase): http://www.quora.com/Quotations/Did-Henry-Ford-actually-say-If-Id-asked-my-customers-what-they-wanted-theyd-have-said-a-faster-horse http://www.quora.com/Quotations/Did-Henry-Ford-actually-say-...
loceng 15y ago
For a good example of this, think Digg vs. Reddit
- aymeric 15y ago
  Do you mean Digg has pushed a big design change and Reddit just does small changes (if any)?

powertower 15y ago

All change is unwelcome at first. It's unfamiliarity. You have to understand this or you'll fail every time. The way to get around this is to make gradual changes.

aymeric 15y ago
Surely some changes can be bad. Facebook Beacon was removed after some time for example. I'd like to know how to figure out what is the fastest to know if a change is for the better or the worse. In the case of design change, I wouldn't expect a direct change in the metrics, it would impact on a longer term though.

revorad 15y ago

If a vocal minority complain about the new design, but still carry on using the app then you probably don't need to worry. Look at the data.

aymeric 15y ago
What data would you look at for a in-app design change?
- revorad 15y ago
  First, I'd just look at the simple overall engagement metrics that matter most to you. For example, if time spent on your web app is most important to you, then see how that was affected by your new design. You could compare the users who say they don't like the new design with the rest of the users. It's likely that some specific features or actions will be affected by a redesign, so track that using Mixpanel or something similar, and again compare old vs new behaviour and complaining users vs others. For example, did people stop clicking on some buttons after the redesign? Did they start buying much less?

JoachimSchipper 15y ago

A/B testing?

aymeric 15y ago
I think A/B testing would take too long to show the effect of the design change. Design helps your users like your app a little bit more and I think it would show in retention, but not in sign up conversion. What metric would you measure?