5 ms·
One of the first computer programs I ever wrote just put random dots on a screen and I remember looking at how 'lumpy' the results were. Intuitively most people
by simonh 11y ago
One of the first computer programs I ever wrote just put random dots on a screen and I remember looking at how 'lumpy' the results were. Intuitively most people assume that random distributions will be even distributions, but in fact they are usually full of clusters. Some mathematicians can reliably distinguish 'random' sequences created by people from truly random ones because people produce distributions that are too smoothed out. 'I won't put a dot here because it's too close to that other dot', but a truly random distribution doesn't care where previous dots were and won't avoid the conjunction.
- dmichulke 11y agoI don't disagree at all and I remember seeing studies or articles writing about that phenomenon. Just wanted to add that a few years ago (when you wrote your first computer program) a randomly selected random number generator was more likely to be less random than a randomly selected random number generator today.
- yitchelle 11y agoThe method described in the article on how the statistician approached the problem is very similar to the approach used in the birthday problem[1]. [1] - https://en.wikipedia.org/wiki/Birthday_problem https://en.wikipedia.org/wiki/Birthday_problem
- DanBC 11y agoEarly random number generation was terrible. You wouldn't get clumps / no clumps, you'd get fuzzy straight lines.
- simonh 11y agoApproximately 35 years ago :)
- lordnacho 11y agoThe iPod shuffle algo was an example of this. It just didn't feel "random" enough for people to have a truly random generator.
- ececconi 11y agoI would think about this all the time when I got a shuffle in high school. After listening to it for a while, I could really predict the next track that would come on even in shuffle mode.
- wodenokoto 11y agoIsn't that also why it is shuffle and not random? When shuffling, you don't risk getting the same song twice in a row.
- eru 11y agoPeople are seldom precise when they talk about randomness. For example, you could mean: picking tracks with `putting back'. You could shuffle tracks like you shuffle a deck of cards, ie picking without putting back. It's still random, but with a different distribution. Even picking the first track with 90% probability, and the rest with some other smaller probability is random. It's just not a uniform distribution.
- benihana 11y agoGreat point. Here's a visualization of what you're talking about: http://bl.ocks.org/mbostock/fe3f75700e70416e37cd http://bl.ocks.org/mbostock/fe3f75700e70416e37cd >Uniform random is pretty terrible. There is both severe under- and oversampling: many samples are densely-packed, even overlapping, leading to large empty areas. (Uniform random sampling also represents the lower bound of quality for the best-candidate algorithm, as when the number of candidates per sample is set to one.) Taken from: http://bost.ocks.org/mike/algorithms/ http://bost.ocks.org/mike/algorithms/
- martin-adams 11y agoI do wonder if that is down to sample size. For example, I wrote a program to simulate the roll of a dice. There is a one in 6 chance of getting any one number. But roll it 6 million times, you'll be very close to have each number 1 million times. So I would anticipate the clumping to even out as the sample size increases. Or maybe the evening out is a large collection of clumps. Anyone know if this is the correct way to think about it?
- mungoman2 11y agoWell depends of what you mean by very close. It's the relative numbers that approaches the true distribution, not the absolute numbers. Do the experiment you decribe and look at the numbers.
- martin-adams 11y agoThis is what I mean: var results = [0,0,0,0,0,0]; for (var i = 0; i < 6000000; i += 1) { results[Math.floor((Math.random() * 6))] += 1; } console.log(results); The results are: [1002140, 999355, 1000009, 1000401, 1000014, 998081] Basically, they are all within 1% tolerance of each number getting 1 million occurrences. So when you look at the clumping on random dots on a screen, given a large enough sample size, I would anticipate that the probability of keeping a clumped visual distribution would become quite improbable.
- ijager 11y agoI think the clumping is more about how many consecutive same numbers there are in the array. For example, a naive me would generate: [3,4,5,1,2,4,2,1,2,6] whereas a true random distribution might generate: [3,4,4,4,4,1,2,2,2]. When you generate 6 million samples you would indeed have about 1 million per number. However you would still have subsequences of the same number.
- gus_massa 11y agoThe problem is not when you have much more samples than slots, in that case you should get "almost" the same number of hits in each slot as you measured. The problem is when you get less samples than slots. For example if you roll 3 dices, you should get "1/2" hits for each result. So the question is: How probable is that one result is repeated? (i.e. you get two equal dices out of the three) [spoiler alert] All equal: 3% Two equal and one different: 42% Three different: 55% "Intuitively", it's expected that with a uniform distribution you get something like 1% + 9% + 90% instead (this numbers are completely made up). Most people don't expect that the probability of getting a repeated dice is so close to the probability of getting all of them different.
- leni536 11y agoAn other great example is how random is a terrible algorithm for dithering. https://en.wikipedia.org/wiki/Dither#Algorithms https://en.wikipedia.org/wiki/Dither#Algorithms
- detrino 11y agoPerhaps just an artifact of a weak PRNG or not truly uniform distribution?
- Sharlin 11y agoNo. A truly uniform random distribution indeed has "clumps".
- detrino 11y agoAnd a poor PRNG or poor implementation of a uniform distribution (both extremely common, for example: rand() % max) has more clumps, my question is still valid. Edit: I wrote a program[1] to fill random pixels based on rand/modulo and mersenne twister/uniform distribution and I could not tell the difference in the generates images. [1] https://gist.github.com/anonymous/9c726ea636f06900ba3a https://gist.github.com/anonymous/9c726ea636f06900ba3a