3 ms·
It's either: - A random number each time - Normal split testing using a cookie - Split testing using the user agent rather than a cookie The last one w
by gkoberger 16y ago
It's either:
- A random number each time
- Normal split testing using a cookie
- Split testing using the user agent rather than a cookie
The last one would, I suppose, be more consistent than using a cookie- after all, most people wouldn't switch browsers, but they might clear their cookies.
That being said, a few companies have gotten in hot water for doing this.
Amazon in 2000: http://news.cnet.com/2100-1017-245631.html http://news.cnet.com/2100-1017-245631.html
Automattic: http://brianbreslin.com/automattic-caught-ab-testing-pricing-for-vaultpress/ http://brianbreslin.com/automattic-caught-ab-testing-pricing... (although they admitted up front they were doing this)
[Edited for readability]
- jwecker 16y agoI can almost guarantee it's simply a split test using a cookie, as that's the standard way to experiment (using Google Website Optimizer and others). It's a common bracketing experiment. Edit: To be clear, if it's flash cookies it could persist after browser installs but still be different per browser.
- deleted 16y ago[deleted]
- unfasten 16y agoI think it's normal split testing using a normal cookie. Here are the rates I get in Opera (with flash disabled) while clearing cookies between reloads: new used refinance 3.10 4.49 4.34 3.50 5.09 4.84 2.70 4.09 3.94 2.30 3.59 3.54 And here's Firefox (with flash enabled) and clearing session cookies between reloads: new used refinance 2.70 4.09 3.94 3.10 4.49 4.34 2.30 3.59 3.54 3.50 5.09 4.84
- joeyo 16y agoANOVA agrees with you: Source Sum Sq. d.f. Mean Sq. F Prob>F ------------------------------------------------------- Loan Type 9.6665 2 4.8333 16.47 0.001 Browser 0 1 0 0 1 Error 5.8700 20 0.2935 Total 15.5365 23