4 ms·
Assuming the people faking these sort of numbers aren't complete morons they'll know that this sort of naive statistical test is the first thing people will try
by dagw 17y ago
Assuming the people faking these sort of numbers aren't complete morons they'll know that this sort of naive statistical test is the first thing people will try. Thus they'll probably run their simulation and then manually poke a few of the numbers to make sure that this sort of test fails.
Also If they're slightly smarter still they'll realize that the chance of getting a question right or wrong is not independent. You're chance of someone getting questions 5-10 right is probably quite closely correlated to whether or not they got questions 1-4 right.
Anyway my basic point is that assuming the person in charge of writing a simulation didn't sleep through all of statistics 101 it is quite trivial to write a simple simulation that won't be detected by simple statistical analysis.
- btilly 17y agoYou're overestimating them. The final digit analysis that broke this whole story is something that only catches numbers being made up by hand. If they rolled a die to randomize things, they wouldn't have left an obvious pattern like that. Given that, it was reasonable to investigate the obvious possibility first for this case. Particularly since there was a suggestion that they had made up the set of numbers with such a simulation.
- dagw 17y agoMaybe I'm guilty of overestimating them, but I always find it hard to believe that people who would go through the trouble of faking these sort of things can be so monumentally stupid. These people work with polling and statistics, they must know about all of these tests. It cannot be that hard to use the knowledge to write a randomizer which produces reasonable results...maybe that's a good idea for a startup.
- camccann 17y agoThese people work with polling and statistics Well, current evidence seems to suggest that maybe they don't, actually, work with polling and statistics...