3 ms·
Product managers are seeing "longer time on site" in their analytics reports and keep adding more things thinking it is meeting the company's quarterly OKR the
by vmception 7y ago
Product managers are seeing "longer time on site" in their analytics reports and keep adding more things thinking it is meeting the company's quarterly OKR
they don't know the "higher engagement" is because the mobile user's browsers are literally frozen
and the A/B test says "keep going with the B test!" "do it again!" in a tree that keeps evolving down one side of the graph towards more and more obnoxious experiences that the company doesn't even know is obnoxious
given the misaligned incentives I think this is also an area California can regulate or threaten to regulate, I don't like "tech regulation" but I can't think of any other party to curb the behavior. If you like "private sector solutions" more than "government solutions" then Apple and Google can pull the rug under all the other company's feet by crashing sites on the user's phone using other user's crowd sourced data, or making certain analytics packages not run, etc.
- creato 7y ago... or maybe it's just a bug?
- vmception 7y agoyes the bug of product managers following A/B tests blindly and not knowing its a bug, resulting in a worse and worse internet browsing experience for all of us
- cameronbrown 7y agoAny company with the ability to measure time-on-site is also at least opening their site.
- kevingadd 7y agoYeah, but probably with a specific browser/os configuration, on high speed office internet. Pretty common to find large websites that just happen to not work right in browser configurations that don't match their developer configuration even if they aren't obscure.
- leshokunin 7y agoUnderrated comment. You’re on the money.