3 ms·

You seem to have a mistaken idea of what user testing is. It's not asking people what they think of this software, it's asking them to perform specific tasks an

You seem to have a mistaken idea of what user testing is. It's not asking people what they think of this software, it's asking them to perform specific tasks and then observing where they make mistakes or have issues. The benefits of user testing are well documented. You're most definitely in the minority position for claiming this.

ThomPete 17y ago
I am quite aware of what a usability test is as I have spend quite some time observing them. But as I have also learned over the years is that usability test does not equal more successful product. You are welcome to prove the benefits claim. I don't care if you can prove some academic self referencing point about usability testing improving customer sentiment. I care about successful products and there is absolutely nothing that proves that usability tests or the UCD method is better than any other design process. What company's success is based on them doing usability tests. By all means, please share.
- shalmanese 17y ago
  http://www.uie.com/articles/three_hund_million_button http://www.uie.com/articles/three_hund_million_button
  - ThomPete 17y ago
    Ehh that is proving my point. That's refinement AFTER launch of the product. That is something entirely different than what that 5USD test is all about.
    - shalmanese 17y ago
      I don't think it is, after all, I wrote that article. Usability testing can be done at all stages of the design cycle from paper prototyping to maintenance.
    - ThomPete 17y ago
      Of course it can be done a all stages. It just doesn't matter in the beginning. Show me examples of companies who wouldn't be a success if it wasn't for the usability testing they did up front. If it's so well proven that should be easy for you. You are confusing improvements to an established already successful e-commerce company with creating one from scratch. It's quite obvious if you already have a successful site you can adjust accordingly which is exactly what Amazon do all the time. Because that is what e-commerce sites must do to keep sales up.
      - shalmanese 17y ago
        Oh, I just noticed that we sparred before around this post: http://000fff.org/getting-to-the-customer-why-everything-you-think-about-user-centred-design-is-wrong/ http://000fff.org/getting-to-the-customer-why-everything-you... about the exact same issue (I am Xianhang Zhang). I don't know if we're going to get any more productive the second time around. Proving usability testing works when creating a product has the same problem with proving something like agile development works. Every project is unique so you never know how things would have turned out if you did things another way. The best you're going to get is anecdotal evidence that early stage usability testing caused significant pivots around the core concept and assume that these pivots are generally positive. Much of the customer development stuff Steve Blank talks about fall into this category.
      - ThomPete 17y ago
        "The best you're going to get is anecdotal evidence that early stage usability testing caused significant pivots around the core concept and assume that these pivots are generally positive. Much of the customer development stuff Steve Blank talks about fall into this category." In other words. There is no evidence what so ever. Thank you for proving my point. I have 15 years of anecdotal evidence that there is no correlation between Usability testing and successful products. And I am still asking you to provide evidence. Twitter, Facebook, Apple, Amazon, LastFM, 37Signals and so on. None of them to my knowledge did usability testing before they launched their products. Again you are welcome to prove me wrong. With regards to Steve Blank then I don't think that is what he is saying. There are however evidence that listening to customers don't help http://entrepreneur.venturebeat.com/2010/02/11/bolt-peters-remote-research/ http://entrepreneur.venturebeat.com/2010/02/11/bolt-peters-r...

ThomPete 17y ago

I am quite aware of what a usability test is as I have spend quite some time observing them. But as I have also learned over the years is that usability test does not equal more successful product. You are welcome to prove the benefits claim. I don't care if you can prove some academic self referencing point about usability testing improving customer sentiment. I care about successful products and there is absolutely nothing that proves that usability tests or the UCD method is better than any other design process. What company's success is based on them doing usability tests. By all means, please share.

shalmanese 17y ago
http://www.uie.com/articles/three_hund_million_button http://www.uie.com/articles/three_hund_million_button
- ThomPete 17y ago
  Ehh that is proving my point. That's refinement AFTER launch of the product. That is something entirely different than what that 5USD test is all about.
  - shalmanese 17y ago
    I don't think it is, after all, I wrote that article. Usability testing can be done at all stages of the design cycle from paper prototyping to maintenance.
  - ThomPete 17y ago
    Of course it can be done a all stages. It just doesn't matter in the beginning. Show me examples of companies who wouldn't be a success if it wasn't for the usability testing they did up front. If it's so well proven that should be easy for you. You are confusing improvements to an established already successful e-commerce company with creating one from scratch. It's quite obvious if you already have a successful site you can adjust accordingly which is exactly what Amazon do all the time. Because that is what e-commerce sites must do to keep sales up.
    - shalmanese 17y ago
      Oh, I just noticed that we sparred before around this post: http://000fff.org/getting-to-the-customer-why-everything-you-think-about-user-centred-design-is-wrong/ http://000fff.org/getting-to-the-customer-why-everything-you... about the exact same issue (I am Xianhang Zhang). I don't know if we're going to get any more productive the second time around. Proving usability testing works when creating a product has the same problem with proving something like agile development works. Every project is unique so you never know how things would have turned out if you did things another way. The best you're going to get is anecdotal evidence that early stage usability testing caused significant pivots around the core concept and assume that these pivots are generally positive. Much of the customer development stuff Steve Blank talks about fall into this category.
    - ThomPete 17y ago
      "The best you're going to get is anecdotal evidence that early stage usability testing caused significant pivots around the core concept and assume that these pivots are generally positive. Much of the customer development stuff Steve Blank talks about fall into this category." In other words. There is no evidence what so ever. Thank you for proving my point. I have 15 years of anecdotal evidence that there is no correlation between Usability testing and successful products. And I am still asking you to provide evidence. Twitter, Facebook, Apple, Amazon, LastFM, 37Signals and so on. None of them to my knowledge did usability testing before they launched their products. Again you are welcome to prove me wrong. With regards to Steve Blank then I don't think that is what he is saying. There are however evidence that listening to customers don't help http://entrepreneur.venturebeat.com/2010/02/11/bolt-peters-remote-research/ http://entrepreneur.venturebeat.com/2010/02/11/bolt-peters-r...