4 ms·

Author of the post here. Thanks for posting it, it's little out of date in terms of the references in there but I stand by the sentiment. Since I wrote the art

by drcongo 11y ago

Author of the post here. Thanks for posting it, it's little out of date in terms of the references in there but I stand by the sentiment. Since I wrote the article I feel like I've seen something of a drop in usage of the kinds of techniques described, total anecdata though. Patreon posted below looks very interesting. Thanks for the heads up.

ggillas 11y ago
If you could update the references, who's doing it right today?
- drcongo 11y ago
  I wish I could remember some of the good ones I've found, and I wish I'd started collecting screenshots of them and done a tumblr in support of their efforts.
jasode 11y ago
From your article, you wrote: >If you want the whole story here you should also be sat in a room testing this modal overlay with real people. Ask them questions: “Do you like that overlay..." [...] It’s extremely unlikely that they like it. Your opinion may ultimately be correct but your justification for it is flawed. If you survey people, you get what's called a "stated preference." (SP) [1] However, there's another concept called a "revealed preference" (RP) [2] and this often contradicts the "stated preference." The web analytics Ramit Sethi believed in may also be flawed. However, the point is that statistics collection attempts to uncover "revealed preferences". Since RP is often hidden, the tools for uncovering it are not surveys. Instead, they use hidden cameras, or Point-Of-Sales transaction data, or eye tracking, or web analytics, etc. There are many examples where RP yields more insight than SP. This is counterintuitive so we end up thinking SP is the correct perspective because it "feels right." Many real world examples have proven SP to be incorrect such as retail sales events, airlines, dating & romance, etc. I can expand those examples, or you can search google if you're curious about them. Annoying ad overlays on web content may be another area where RP trumps SP. I haven't researched it enough to know. Your article gives more weight to SP than RP with no justification why it should. [1]https://en.wikipedia.org/wiki/Choice_modelling#Stated_preference https://en.wikipedia.org/wiki/Choice_modelling#Stated_prefer... [2]https://en.wikipedia.org/wiki/Revealed_preference https://en.wikipedia.org/wiki/Revealed_preference
- calinet6 11y ago
  Okay, I challenge you to discover a "revealed preference" that says they like overlays. Not that they click them, not that it "results in an action," but that they like them and they will be more likely to return to the site because of the positive and enjoyable experience of the popup. There are a few dozen confounding variables in your analysis as well if you want to look for the revealed preference. Why are users clicking the modals? Are they certain that they have a choice? In the article, the author makes the excellent point that many people believe that they must complete the modal to continue reading the article. That's not preference, that's coercion. So, sure, it's valuable to understand revealed preferences without bias of leading questions. Absolutely. But you still have to keep your head on and understand the variables you're measuring, the confounding variables, and larger effects at play. This question comes up a lot in user experience design, with stated preference vs. revealed preference (how you do user testing and surveying vs. how users actually use the product unprompted), and the larger macro-scale question of what actually makes a quality experience. Often making all the decisions about the user experience from microinteraction tests leads to a poor overall experience, and it's exactly because of too much focus on 'what works' without understanding how the measurements are being made and how we should interpret that data.
  - jasode 11y ago
    >, I challenge you to discover a "revealed preference" that says they like overlays. That's not my position. I never proposed that web surfers "like" modal overlays. I think we can all agree that intrusive overlays annoy everyone. The "revealed preference" I'm talking about isn't referencing the modal overlays specifically. The RP reference is to the "whole story" (to put it in author's words). To me, the "whole story" is how the website measures the value of its content, how it monetizes it, what % of people never want to return, what is a sustainable audience, etc, etc. There are multiple dimensions to what people "like/dislike" and people assign different (and hidden) weights to them. The author wrote: >They will falsely conclude that people love these modal overlays. I've never heard any sane UI developer or programmer expound that position. That looks like twisting the words of what they actually think (aka a straw man). The actual conclusion by them is more accurately portrayed as, "they conclude that greater % people love THE CONTENT MORE THAN THE INCONVENIENCES of these modal overlays. The % of people who tc;dr is real but small enough % to be acceptable collateral damage." The RP behavior analysis attempts to answer that second thesis. Surveys and questionnaires are the wrong tool for it.

by drcongo 11y ago

ggillas 11y ago

If you could update the references, who's doing it right today?

drcongo 11y ago
I wish I could remember some of the good ones I've found, and I wish I'd started collecting screenshots of them and done a tumblr in support of their efforts.

jasode 11y ago

From your article, you wrote: >If you want the whole story here you should also be sat in a room testing this modal overlay with real people. Ask them questions: “Do you like that overlay..." [...] It’s extremely unlikely that they like it. Your opinion may ultimately be correct but your justification for it is flawed. If you survey people, you get what's called a "stated preference." (SP) [1] However, there's another concept called a "revealed preference" (RP) [2] and this often contradicts the "stated preference." The web analytics Ramit Sethi believed in may also be flawed. However, the point is that statistics collection attempts to uncover "revealed preferences". Since RP is often hidden, the tools for uncovering it are not surveys. Instead, they use hidden cameras, or Point-Of-Sales transaction data, or eye tracking, or web analytics, etc. There are many examples where RP yields more insight than SP. This is counterintuitive so we end up thinking SP is the correct perspective because it "feels right." Many real world examples have proven SP to be incorrect such as retail sales events, airlines, dating & romance, etc. I can expand those examples, or you can search google if you're curious about them. Annoying ad overlays on web content may be another area where RP trumps SP. I haven't researched it enough to know. Your article gives more weight to SP than RP with no justification why it should. [1]https://en.wikipedia.org/wiki/Choice_modelling#Stated_preference https://en.wikipedia.org/wiki/Choice_modelling#Stated_prefer... [2]https://en.wikipedia.org/wiki/Revealed_preference https://en.wikipedia.org/wiki/Revealed_preference

calinet6 11y ago
Okay, I challenge you to discover a "revealed preference" that says they like overlays. Not that they click them, not that it "results in an action," but that they like them and they will be more likely to return to the site because of the positive and enjoyable experience of the popup. There are a few dozen confounding variables in your analysis as well if you want to look for the revealed preference. Why are users clicking the modals? Are they certain that they have a choice? In the article, the author makes the excellent point that many people believe that they must complete the modal to continue reading the article. That's not preference, that's coercion. So, sure, it's valuable to understand revealed preferences without bias of leading questions. Absolutely. But you still have to keep your head on and understand the variables you're measuring, the confounding variables, and larger effects at play. This question comes up a lot in user experience design, with stated preference vs. revealed preference (how you do user testing and surveying vs. how users actually use the product unprompted), and the larger macro-scale question of what actually makes a quality experience. Often making all the decisions about the user experience from microinteraction tests leads to a poor overall experience, and it's exactly because of too much focus on 'what works' without understanding how the measurements are being made and how we should interpret that data.
- jasode 11y ago
  >, I challenge you to discover a "revealed preference" that says they like overlays. That's not my position. I never proposed that web surfers "like" modal overlays. I think we can all agree that intrusive overlays annoy everyone. The "revealed preference" I'm talking about isn't referencing the modal overlays specifically. The RP reference is to the "whole story" (to put it in author's words). To me, the "whole story" is how the website measures the value of its content, how it monetizes it, what % of people never want to return, what is a sustainable audience, etc, etc. There are multiple dimensions to what people "like/dislike" and people assign different (and hidden) weights to them. The author wrote: >They will falsely conclude that people love these modal overlays. I've never heard any sane UI developer or programmer expound that position. That looks like twisting the words of what they actually think (aka a straw man). The actual conclusion by them is more accurately portrayed as, "they conclude that greater % people love THE CONTENT MORE THAN THE INCONVENIENCES of these modal overlays. The % of people who tc;dr is real but small enough % to be acceptable collateral damage." The RP behavior analysis attempts to answer that second thesis. Surveys and questionnaires are the wrong tool for it.