4 ms·

Not at all true. I've sat through professional usability tests of things I have designed and have been amazed at the things people trip on that you wouldn't exp

Not at all true. I've sat through professional usability tests of things I have designed and have been amazed at the things people trip on that you wouldn't expect. There's great value in usability testing to find the flaws in your design (yes, your design can almost always be improved upon) as well as ammunition to defend the decisions you made against stupid requests from management.

ThomPete 16y ago
You seem to be assuming that this matters? Of course your design can alway be improved. But the real question is whether those improvements are making you that much more successful. And that I don't believe is the case.
- jrwoodruff 16y ago
  This is very interesting actually... I just checked your profile and realized that I have your latest post bookmarked, one that I agree with very much. I still say usability testing has value, but you have to make sure you're using it in the context of the test subjects experience, and as one of many inputs in the design process. Of course, I work in state government, so the process is a bit different than a startup. However, I still think there's a healthy amount of humility that is gained from watching customers use your design.
  - ThomPete 16y ago
    I am not against testing. I am against testing on users in pseudo environments such as mockups, wireframes, designed but death screens and even most types of prototyping. Getting someone from the outsides opinion is nothing more than that. An opinion. But it is often taken as gospel and have way to large effect on the actual development of the product/service. And in my experience whether that is government, large and small organizations and startups. The problem persists. Don't test something that isn't real on end users. But ya my views are a little extreme.
    - thorax 16y ago
      > But it is often taken as gospel I agree with you that it shouldn't be taken as gospel. I disagree with you saying it doesn't have a place and shouldn't be done. As with all feedback, you have to give it the appropriate weight and factor in the likeliness that it was an off-shoot. It sounds like your issue isn't the data, it's how some clients/people weigh that data. Is that true?
      - ThomPete 16y ago
        Not really. Have been doing it for 15 years worked with Fortune100 and small clients and government. The last 5 years after I was head of my own company, we have started to advice against using it. And to great success might I add. We have turned the process around and am now advising our clients to save those money for later after the product has launched. We have had no more problems than we used to and now we have budget to fix it where it matters instead of having to have the client find even more money. The problem is that giving it the appropriate weight still doesn't solve the problem of transcendence between findings, decisions and design. So the problem is with the entire process rather than people or data. Usability testing is concerned with improving usability and obviously if your usability doesn't make it useless then you are in better shape than if not. But there is quite a range from completely useless to useful to best UI you can ever imagine. And to most clients it really isn't before they launch that they will get the feedback that matters. And as I have said repeatedly. Improving usability isn't in itself improving your product in any shape or form that makes it more or less successful. Yes if you make it useless then obviously it matters. But no one worth their pay does that. So instead. Get good designers who both can do UX and the visual side and you wont need to plaster it up with in most cases useless time that could be spend improving the actual product rather than some pre-state of it.
        thorax 16y ago
        Your experience is so different than mine that I find it quite fascinating. I hope you continue your successes! After my own fifteen years of product engineering, I personally do not have the courage to push forward with a major design (be it code, product, etc) without some external feedback validating it.

ThomPete 16y ago

You seem to be assuming that this matters? Of course your design can alway be improved. But the real question is whether those improvements are making you that much more successful. And that I don't believe is the case.

jrwoodruff 16y ago
This is very interesting actually... I just checked your profile and realized that I have your latest post bookmarked, one that I agree with very much. I still say usability testing has value, but you have to make sure you're using it in the context of the test subjects experience, and as one of many inputs in the design process. Of course, I work in state government, so the process is a bit different than a startup. However, I still think there's a healthy amount of humility that is gained from watching customers use your design.
- ThomPete 16y ago
  I am not against testing. I am against testing on users in pseudo environments such as mockups, wireframes, designed but death screens and even most types of prototyping. Getting someone from the outsides opinion is nothing more than that. An opinion. But it is often taken as gospel and have way to large effect on the actual development of the product/service. And in my experience whether that is government, large and small organizations and startups. The problem persists. Don't test something that isn't real on end users. But ya my views are a little extreme.
  - thorax 16y ago
    > But it is often taken as gospel I agree with you that it shouldn't be taken as gospel. I disagree with you saying it doesn't have a place and shouldn't be done. As with all feedback, you have to give it the appropriate weight and factor in the likeliness that it was an off-shoot. It sounds like your issue isn't the data, it's how some clients/people weigh that data. Is that true?
    - ThomPete 16y ago
      Not really. Have been doing it for 15 years worked with Fortune100 and small clients and government. The last 5 years after I was head of my own company, we have started to advice against using it. And to great success might I add. We have turned the process around and am now advising our clients to save those money for later after the product has launched. We have had no more problems than we used to and now we have budget to fix it where it matters instead of having to have the client find even more money. The problem is that giving it the appropriate weight still doesn't solve the problem of transcendence between findings, decisions and design. So the problem is with the entire process rather than people or data. Usability testing is concerned with improving usability and obviously if your usability doesn't make it useless then you are in better shape than if not. But there is quite a range from completely useless to useful to best UI you can ever imagine. And to most clients it really isn't before they launch that they will get the feedback that matters. And as I have said repeatedly. Improving usability isn't in itself improving your product in any shape or form that makes it more or less successful. Yes if you make it useless then obviously it matters. But no one worth their pay does that. So instead. Get good designers who both can do UX and the visual side and you wont need to plaster it up with in most cases useless time that could be spend improving the actual product rather than some pre-state of it.
      - thorax 16y ago
        Your experience is so different than mine that I find it quite fascinating. I hope you continue your successes! After my own fifteen years of product engineering, I personally do not have the courage to push forward with a major design (be it code, product, etc) without some external feedback validating it.