3 ms·
People, depending on their expectations, will perceive your app as one of these categories: - A: not slow - B: slow, but still using - C: intolerably slow an
by tlb 6y ago
People, depending on their expectations, will perceive your app as one of these categories:
- A: not slow
- B: slow, but still using
- C: intolerably slow and no longer use it
Indeed, you can't measure C with a survey. But for most apps, it's probably reasonable to assume a distribution of thresholds where, if B/(A+B) (ie, the result you get on a survey of users for "is it slow") is less than 5%, there probably aren't many in C.
- cxr 6y agoThat's bad science.
- tlb 6y agoUser surveys are never going to be good science. Surveys are confounded by massive variation in response rates. For instance, I haven't filled out a user survey in many years because I have better things to do. They can only ever give a vague indication that something might or might not be a common issue. The scientific approach to find out if app slowness is a problem is to make a much faster version, give that to some fraction of users in an RCT and see if their usage goes up. But that makes no sense for a business. If you make the effort to develop a fast version, just give that to everyone and move on to the next thing that might get you more users.