2 ms·
Making technical and functional changes results in an inability to explain A/B tests that attempt to prove that the migration did not have negative effects. If
by hrpnk 4y ago
Making technical and functional changes results in an inability to explain A/B tests that attempt to prove that the migration did not have negative effects.
If you change UX as part of the migration, you're often unable to tell whether the cause was technical or functional. It's just too easy to say that it must be the technical side, but you don't have tangible data unless you actually compare the functional changes built on top of the same technical foundation.
Another aspect are behavioral metrics that may change between two implementations making these difficult to compare.