I understand that. The blog post I linked to describes doing exactly that. But the point I'm making is different. This is a lot of stuff to get right and most

I understand that. The blog post I linked to describes doing exactly that. But the point I'm making is different. This is a lot of stuff to get right and most people aren't that sophisticated. Getting A/B tests right is a lot easier, mainly because they are significantly more robust to model error.