3 ms·
Soon after my startup launched, Gwern asked to do a test of our reading-enhancement technology on his site. His test is now described in the Abandoned section o
by gnicholas 5y ago
Soon after my startup launched, Gwern asked to do a test of our reading-enhancement technology on his site. His test is now described in the Abandoned section on the linked page. [1]
I learned a very valuable lesson from our interaction: having someone test out your software in a public way is great, but if they fundamentally disagree with how the UX should function, you can't cede control.
Gwern disagreed with us on two fundamental points: (1) which color schemes to use, and (2) whether the user should be aware of (and presumably control) the activation and settings of the technology.
We knew from our usage data that practically no one used the greyscale theme — almost everyone used our colored themes. We also suspected that running a test where users were not made aware of the purpose of the color gradients would confuse and possibly annoy users — especially if they couldn't turn it on/off or change the colors.
The results were not surprising to us: lots of people were confused, and the color-based themes were more popular than he anticipated. In all of our subsequent partnerships/testing, we firmed up our UX guidelines and didn't so much control of testing procedures.
It was perhaps the right move to be flexible in the beginning — who were we, next to the mighty Gwern! But looking back it would have been much better for us (and I think Gwern as well) if the UX had been done in a way that gives users control. One nice looking example of our desired UX is here. [2]
1: https://www.gwern.net/Design#abandoned https://www.gwern.net/Design#abandoned
2: https://unreasonable.is/how-to-stop-working-and-be-more-productive/ https://unreasonable.is/how-to-stop-working-and-be-more-prod...