You are on the right track, but no, it is more subtle than that. The test could still be meaningful depending on what probability of false positives you are wil

You are on the right track, but no, it is more subtle than that. The test could still be meaningful depending on what probability of false positives you are willing to accept. [1] http://en.wikipedia.org/wiki/P-value http://en.wikipedia.org/wiki/P-value [2] http://en.wikipedia.org/wiki/Type_I_and_type_II_errors http://en.wikipedia.org/wiki/Type_I_and_type_II_errors