A short primer in unconstrained, high-dimensional, non-linear global optimization (over time!) You can't do it. So you need more than just testing.

A short primer in unconstrained, high-dimensional, non-linear global optimization (over time!) You can't do it. So you need more than just testing. Unconstrained and high-dimensional means that your search space is IMMENSE. Non-linear means that the optimal designs may be arbitrarily twisty, very small, fractaline and chaotic, and, most importantly, unconnected. Temporal dependence means that even if you magically find a good solution, it may fade with time. Fortunately, we never have to do that because we use an incredible amount of prior design information (craft) to ensure that our search spaces are much smaller. This page provides an overview of that information (and even includes a call to test) which will hopefully put you somewhere in the neighborhood of a useful page and inform you of what direction to go. If you "just had to test" then there'd be no need for art, science, literature, stock markets, language, thermodynamics, technique, craft, effort. Computers would have already solved everything (not that we would have ever invented them). My opinion is that testing is vital because it's your only consistent, trust-worthy way to measure your value function (conversion rates). It's how you put a stick in the water to measure depth. That is only one tiny part of a complete solution no matter how important it is.