2 ms·
Let's take a different example. Let's say you have a search box. Option A generates 10 times more searches than option B. This may mean the search box is 10 ti
by marginalia_nu 4y ago
Let's take a different example. Let's say you have a search box.
Option A generates 10 times more searches than option B. This may mean the search box is 10 times more useful than in the B case, or the users require 10 times as many searches to find what they want. Looking at the data, you really can't tell. Even without the data, you can dogfood your application and fairly quickly tell whether the feature is good or bad.
I'm not saying anyone is stupid. Naive, perhaps, but not stupid.
The problem is that interpreting data is difficult. Incredibly difficult. Scientists, who construct experiments and interpret experimental data for a living, with a decade of education behind their back, get this wrong all the time.