3 ms·
> You can be sure that the people interested in conversions run analytics and A/B testing on everything. If these pop-ups did a poor job and there was a better
by _gabe_ 3y ago
> You can be sure that the people interested in conversions run analytics and A/B testing on everything. If these pop-ups did a poor job and there was a better alternative, you can be sure that everyone would have already migrated to that alternative.
And this is the problem with modern corporate logos. They think if the A/B numbers are trending up, it must always be a good thing. Nobody does real UX testing like Microsoft, Amazon, Apple, etc used to do. You know where they actually track down a non-technical person, sit them down in front of a computer, open up the website/app, see what the user does, then ask about how the experience was. This is UX testing and will lead to meaningful impacts. A/B tests are inane methodologies that are formatted to confirm whatever preconceived notions upper management wanted to hear anyways.
A more concrete piece of anecdata; my upper management told me they wanted us to boost the priority for sales eligible customers. I asked if this means we would prioritize people not paying for our service (since they're eligible for sales) and de-prioritize our already paying customers (who are not eligible). Upper management basically said, "yup that will happen. But it will increase our conversion rates which is what we care about". News flash, ruining your company's reputation for some shitty KPIs will damage your company in the long term.
Prioritizing shitty A/B tests will eventually ruin your company. It may not be immediate, but the slow and inevitable degradation of a useful product will lead to utter contempt and disdain from your users and they will switch to an alternative that actually prioritizes UX. See: Medium -> Substack, Microsoft -> Apple, and more I can't think of off the top of my head. We forget that the reason the iPhone was so wildly successful was because Steve Jobs was obsessed with creating a meticulously crafted UX. We forget that Nintentdo shenanigans are tolerated only because the games are lovingly crafted and built by people that care about their target audience. We forget that Amazon took off because of Customer Obsession, among other admirable qualities (that unfortunately aren't followed as well anymore). Keep treating your users as dumb cattle and they'll wise up and leave. The users aren't stupid, they're just waiting for a viable alternative so they can finally dump the shitty product built by companies prioritizing all the wrong metrics.
- tootie 3y agoYou're wrong though. Moderated and unmoderated user testing is more prevalent than ever.