4 ms·

I appreciate the discussion, let me clarify. > a random sequence of 39 heads is less probable than three sequences of 13 heads, each separated by some other un

I appreciate the discussion, let me clarify. > a random sequence of 39 heads is less probable than three sequences of 13 heads, each separated by some other unidentified, random sequences Investors are not going for streaks. They are going for overall return. A better way to put it: what are the chances that over a 48-year timeframe, a random strategy will return ~20% annualized return compared to the market's ~10%? Ignore an arbitrary year limitation (why not measure monthly or daily return?). What is the chance a random strategy would outperform so long? Or, a better question: what is a chance that a random strategy will be the best-performing investment over a 30-year period (1926-2011), and the subject of academic studies: http://www.econ.yale.edu/~af227/pdf/Buffett's%20Alpha%20-%20Frazzini,%20Kabiller%20and%20Pedersen.pdf http://www.econ.yale.edu/~af227/pdf/Buffett's%20Alpha%20-%20... Buffett is an existence proof that investment is skill, not chance. He created the 9th most valuable company in the world. You can believe that was entirely due to chance if you wish. (On beating the market consistently: you don't have to crush the market to extract value. Certain strategies only work for certain amounts of capital. You can be an Apex predator and not drive the entire ecosystem into extinction.)

lutusp 13y ago
> A better way to put it: what are the chances that over a 48-year timeframe, a random strategy will return ~20% annualized return compared to the market's ~10%? Easily answered. Let's say that a 10% return is the mean return, and one standard deviation is 5% -- just an example, and these numbers aren't real (although they could be established by asking everyone what their returns are). So a return of 20% or better represents two standard deviations above the norm, or 2.2% of the investing population (this is a one-tailed distribution). How many investors will achieve that result in a large population? 2.2%. In a pool of a million investors, that's 22,000 people. > Buffett is an existence proof that investment is skill, not chance. With all respect, it's more accurate to say that your view of probability is an existence proof that many people don't understand statistics. Let me ask you -- do you understand how science works? Scientists don't say what you just said, ever. They say that the probability that this outcome resulted from chance is p ("p-value"), referring to the probability that the result arose because of chance. (My 2.2% probability above is a p-value.) When the LHC scientists announced that they believed they might have detected the Higgs boson, did they say that their measurement constituted an "existence proof" that the Higgs was real? No, because they were scientists addressing educated people, they expressed their result in terms of a p-value -- p was the probability that their result came about because of chance, not the hypothesized particle. A chance result isn't the last possibility that a scientist considers, it's the first. And no one who has been educated claims that a result that might have arisen by chance constitutes an "existence proof".
- throwawaymsft 13y ago
  I am not an expert in the scientific method, but know a P value of < .05 (in this case, 39/47 is more like .000001) is pretty strong evidence of the conclusion. Of course things can always be due to chance; I may not be a person, but a chimp randomly hitting keys. At what point do you say "The hypothesis that a professional investor with a published strategy who returns the best-performing fund in history appears to not be based on chance?". Do you really think 2% of investors (1 in 50!) achieve 20% compound growth over 48 years? Do you know how many billions that is? (Buffet started with $100k and grew it to the 9th biggest company in the world. Where are the thousands of other investing billionaires?) Do you really think beating the market long-term is a simple 1-time standard deviation computation? (I thought it was impossible, now 50% of people will consistently beat the market long term by any margin?) Per the cited article, from trained economists: "Buffett’s success has become the focal point of the debate on market efficiency that continues to be at the heart of financial economics. Efficient market academics suggest that his success may simply be luck, the happy winner of a coin-flipping contest as articulated by Michael Jensen at a famous 1984 conference at Columbia Business School celebrating the 50th anniversary of the book by Graham and Dodd (1934). Tests of this argument via a statistical analysis of the extremity of Buffett’s performance cannot fully resolve the issue."
  - lutusp 13y ago
    > ... but know a P value of < .05 (in this case, 39/47 is more like .000001) is pretty strong evidence of the conclusion. This is false, and the fact that it's false has been proven and accepted for years. http://www.nature.com/news/scientific-method-statistical-errors-1.14700 http://www.nature.com/news/scientific-method-statistical-err... Quote: "P values, the 'gold standard' of statistical validity, are not as reliable as many scientists assume." http://bigthink.com/neurobonkers/the-statistical-significance-scandal-the-standard-error-of-science http://bigthink.com/neurobonkers/the-statistical-significanc... Quote: "P<0.05 is the figure you will often find printed on an academic paper, that is commonly (mis)understood as indicating that the findings have a one in twenty chance of being incorrect." Also, your effort to estimate the probability of 39/47 is seriously flawed -- it depends on the distribution of successes and failures within the list. > At what point do you say "The hypothesis that a professional investor with a published strategy who returns the best-performing fund in history appears to not be based on chance?". Have you been reading my replies? The answer is never. The scientists at the LHC have acquired a p-value of 5-sigma for their observation of the Higgs, meaning the probability that their apparent detection of the Higgs arose from chance is 2.8 * 10^-7 (the "p-value"), but guess what? They are never going to say, "We detected the Higgs." Only ignorant science journalists say things like that, in the same way that ignorant stock market journalists say, "So-and-so has a reliable method for beating the market." > Do you really think beating the market long-term is a simple 1-time standard deviation computation? Yes, that's exactly what it is, given adequate data. And if that cannot be done, then economics has earned its reputation as a non-science. > Do you really think 2% of investors (1 in 50!) achieve 20% compound growth over 48 years? That was a hypothetical example, don't try to use it as an argument. > I thought it was impossible, now 50% of people will consistently beat the market long term by any margin? You will need to try to edit your posts to make them comprehensible. If you're asserting this viewpoint, I can prove that, for a random market with random buys and sells, with millions of investors, (a) 50% will do better than the average (uncontroversial), and (b) many of them will become rich by chance alone -- not just do better than the average, but become very rich with a small initial stake. Details here: http://arachnoid.com/equities_myths/index.html#Market_Model http://arachnoid.com/equities_myths/index.html#Market_Model > Per the cited article, from trained economists ... What? You're invoking the authority of "trained economists" to bolster your viewpoint? First, economists aren't scientists, second, an appeal to authority is a logical error, and third, your choice of quotation supports my view, not yours. But I ask you to examine your position, and I shall help you do this by way of a reductio ad absurdum. Let's say there's a system for improving on average market returns, that it's something other than a chance outcome, and that it can be defined, tested, and thereby proven to exist in a scientific sense -- that it can be raised above the level of cocktail chatter. 1: Thesis: There is a way to trade securities that can be assured to reliably improve on average market returns, by means other than chance. The method can be written down, and therefore it can be tested objectively. 2: If (1) is correct, then anyone could take the proven, defined method, apply it to the market on a large scale, and drain it of all its capital in a short time. 3: But, notwithstanding the certainty of human greed and simple curiosity, (2) has not happened, anywhere, ever. 4: Therefore (1) is false. Why is that definitive? Because science cannot be just descriptions ("Warren Buffett has an equities track record"), it requires explanations ("This is why Warren Buffett has an equities track record"). If there is no explanation, there's no science, and there's no point in conversations like this one. Anyone can describe something in the environment, but the only interesting ideas are those accompanies by a testable explanation, a theory that purports to explain some aspect of nature, a theory subject to empirical test. And the outcome is interesting whether the theory turns out to be true or false -- we learn just as much from false scientific theories as true scientific theories. And this is a classic debate between someone who understands science, and someone who doesn't.

lutusp 13y ago

> A better way to put it: what are the chances that over a 48-year timeframe, a random strategy will return ~20% annualized return compared to the market's ~10%? Easily answered. Let's say that a 10% return is the mean return, and one standard deviation is 5% -- just an example, and these numbers aren't real (although they could be established by asking everyone what their returns are). So a return of 20% or better represents two standard deviations above the norm, or 2.2% of the investing population (this is a one-tailed distribution). How many investors will achieve that result in a large population? 2.2%. In a pool of a million investors, that's 22,000 people. > Buffett is an existence proof that investment is skill, not chance. With all respect, it's more accurate to say that your view of probability is an existence proof that many people don't understand statistics. Let me ask you -- do you understand how science works? Scientists don't say what you just said, ever. They say that the probability that this outcome resulted from chance is p ("p-value"), referring to the probability that the result arose because of chance. (My 2.2% probability above is a p-value.) When the LHC scientists announced that they believed they might have detected the Higgs boson, did they say that their measurement constituted an "existence proof" that the Higgs was real? No, because they were scientists addressing educated people, they expressed their result in terms of a p-value -- p was the probability that their result came about because of chance, not the hypothesized particle. A chance result isn't the last possibility that a scientist considers, it's the first. And no one who has been educated claims that a result that might have arisen by chance constitutes an "existence proof".

throwawaymsft 13y ago
I am not an expert in the scientific method, but know a P value of < .05 (in this case, 39/47 is more like .000001) is pretty strong evidence of the conclusion. Of course things can always be due to chance; I may not be a person, but a chimp randomly hitting keys. At what point do you say "The hypothesis that a professional investor with a published strategy who returns the best-performing fund in history appears to not be based on chance?". Do you really think 2% of investors (1 in 50!) achieve 20% compound growth over 48 years? Do you know how many billions that is? (Buffet started with $100k and grew it to the 9th biggest company in the world. Where are the thousands of other investing billionaires?) Do you really think beating the market long-term is a simple 1-time standard deviation computation? (I thought it was impossible, now 50% of people will consistently beat the market long term by any margin?) Per the cited article, from trained economists: "Buffett’s success has become the focal point of the debate on market efficiency that continues to be at the heart of financial economics. Efficient market academics suggest that his success may simply be luck, the happy winner of a coin-flipping contest as articulated by Michael Jensen at a famous 1984 conference at Columbia Business School celebrating the 50th anniversary of the book by Graham and Dodd (1934). Tests of this argument via a statistical analysis of the extremity of Buffett’s performance cannot fully resolve the issue."
- lutusp 13y ago
  > ... but know a P value of < .05 (in this case, 39/47 is more like .000001) is pretty strong evidence of the conclusion. This is false, and the fact that it's false has been proven and accepted for years. http://www.nature.com/news/scientific-method-statistical-errors-1.14700 http://www.nature.com/news/scientific-method-statistical-err... Quote: "P values, the 'gold standard' of statistical validity, are not as reliable as many scientists assume." http://bigthink.com/neurobonkers/the-statistical-significance-scandal-the-standard-error-of-science http://bigthink.com/neurobonkers/the-statistical-significanc... Quote: "P<0.05 is the figure you will often find printed on an academic paper, that is commonly (mis)understood as indicating that the findings have a one in twenty chance of being incorrect." Also, your effort to estimate the probability of 39/47 is seriously flawed -- it depends on the distribution of successes and failures within the list. > At what point do you say "The hypothesis that a professional investor with a published strategy who returns the best-performing fund in history appears to not be based on chance?". Have you been reading my replies? The answer is never. The scientists at the LHC have acquired a p-value of 5-sigma for their observation of the Higgs, meaning the probability that their apparent detection of the Higgs arose from chance is 2.8 * 10^-7 (the "p-value"), but guess what? They are never going to say, "We detected the Higgs." Only ignorant science journalists say things like that, in the same way that ignorant stock market journalists say, "So-and-so has a reliable method for beating the market." > Do you really think beating the market long-term is a simple 1-time standard deviation computation? Yes, that's exactly what it is, given adequate data. And if that cannot be done, then economics has earned its reputation as a non-science. > Do you really think 2% of investors (1 in 50!) achieve 20% compound growth over 48 years? That was a hypothetical example, don't try to use it as an argument. > I thought it was impossible, now 50% of people will consistently beat the market long term by any margin? You will need to try to edit your posts to make them comprehensible. If you're asserting this viewpoint, I can prove that, for a random market with random buys and sells, with millions of investors, (a) 50% will do better than the average (uncontroversial), and (b) many of them will become rich by chance alone -- not just do better than the average, but become very rich with a small initial stake. Details here: http://arachnoid.com/equities_myths/index.html#Market_Model http://arachnoid.com/equities_myths/index.html#Market_Model > Per the cited article, from trained economists ... What? You're invoking the authority of "trained economists" to bolster your viewpoint? First, economists aren't scientists, second, an appeal to authority is a logical error, and third, your choice of quotation supports my view, not yours. But I ask you to examine your position, and I shall help you do this by way of a reductio ad absurdum. Let's say there's a system for improving on average market returns, that it's something other than a chance outcome, and that it can be defined, tested, and thereby proven to exist in a scientific sense -- that it can be raised above the level of cocktail chatter. 1: Thesis: There is a way to trade securities that can be assured to reliably improve on average market returns, by means other than chance. The method can be written down, and therefore it can be tested objectively. 2: If (1) is correct, then anyone could take the proven, defined method, apply it to the market on a large scale, and drain it of all its capital in a short time. 3: But, notwithstanding the certainty of human greed and simple curiosity, (2) has not happened, anywhere, ever. 4: Therefore (1) is false. Why is that definitive? Because science cannot be just descriptions ("Warren Buffett has an equities track record"), it requires explanations ("This is why Warren Buffett has an equities track record"). If there is no explanation, there's no science, and there's no point in conversations like this one. Anyone can describe something in the environment, but the only interesting ideas are those accompanies by a testable explanation, a theory that purports to explain some aspect of nature, a theory subject to empirical test. And the outcome is interesting whether the theory turns out to be true or false -- we learn just as much from false scientific theories as true scientific theories. And this is a classic debate between someone who understands science, and someone who doesn't.