6 ms·
> I don't think there's a constraint on "Nate Silver has a probability model" that mathematically guarantees "Nate Silver's probability model" is correct If I
by baddox 8y ago
> I don't think there's a constraint on "Nate Silver has a probability model" that mathematically guarantees "Nate Silver's probability model" is correct
If I'm understanding the article correctly, it's not talking about models being "correct," it's just talking about the probabilities of all the outcomes adding up to 100%, which means you can't place a bet that guarantees you make money regardless of the outcome.
In other words, offering a bet that was based on the claim that there is a 99% chance of rain today in the Atacama Desert, and a 1% chance of no rain there, is arbitrage-free. It's still clearly a poor probability model for one of the driest places on Earth, but it's arbitrage-free.
- ska 8y agoYes, that's exactly what they mean.
- ikeboy 8y agoIf over time, your forecasts predictably change, then you can be arbitraged. If e.g. I know that you'll have a probability below 40% at some point in the future, and I know you'll have a number above 41% at some point in the future, then it's trivial to create a strategy over time that is guaranteed to make money. Taleb's claim, as I understand it, is that Silver is incorporating random noise into his model and so will exhibit such predictably swings, which enables arbitrage.
- andrewla 8y agoSo what you're saying, I guess, is that Silver, by dint of making point probability predictions, is offering a two-sided market with infinite liquidity trading at that value for a binary option, and you could make arbitrage gains by trading off of volatility? I'm having a fair bit of trouble picking up that from either Taleb's or Clayton's article, but let's say that it's a fair assessment. Is the complaint that the observed variance is high enough to enable these arbitrages? So in order to make his model arbitrage-free, Silver would have to provide a spread rather than a point price, with his forecast as the midpoint of the spread, and the width of the spread wide enough that .5 is always inside the spread, thus making the forecast economically useless? Or is it that Silver does not provide error bars that would estimate that uncertainty? Or is it that because of intrinsic uncertainty in the election?
- ikeboy 8y agoWell obviously Silver isn't actually offering to bet at those odds. But complaining that a model is incorrect because it enables arbitrage is a standard complaint, it's how you can prove all non-Bayesian models are irrational. That doesn't mean all Bayesian ones automatically pass the test though. Error bars and spreads are already outside the Bayesian paradigm, which demands a single number.
- et2o 8y agoCurious about this. > It's how you can prove all non-Bayesian models are irrational Can you expand or link? > Error bars and spreads are already outside the Bayesian paradigm, which demands a single number Not following at all. What do you mean?
- ikeboy 8y agohttps://plato.stanford.edu/entries/epistemology-bayesian/supplement2.html https://plato.stanford.edu/entries/epistemology-bayesian/sup... >Not following at all. What do you mean? One assumption is that given a bet, you must choose to take a side of it. If you won't bet for something at X%, you must bet against it at 1-X%.
- et2o 8y agoAh, interesting link. I think I ran into some confusion since 'rational' and 'Bayesian' are somewhat overloaded terms. When I think of Bayesian analysis, I always think of Bayesian models which attempt to model uncertainty and always have a posterior distribution (spread) of outcomes. For example, in the Dutch Book page, instead of having a point-prior (P=0.51 (delta on P=0.51?)), each degree of belief could have some (different) distribution which could yield a posterior with a distribution and change the math here.
- ikeboy 8y agoYeah well there's a difference if you're estimating a parameter or predicting true/false on an event.
- mannykannot 8y agoIf over time, your forecasts predictably change, then they are not the best forecasts you could make with the information on hand (I take it that by "predictably change", you mean that they will change in a predictable way, not just that it is predictable that they will change somehow.) If I am not mistaken, an opportunity for arbitrage is not created merely by a certainty that they will change somehow; it would require that they change in a specific way, and deterministically so. Absent this, a bet would just be speculation, not arbitrage.
- ikeboy 8y ago>If over time, your forecasts predictably change, then they are not the best forecasts you could make with the information on hand. And this is precisely the complaint Taleb is making. An arbitrage is just a strategy that's guaranteed to make money. If you know for sure that something will go up and down at different points you could make money risk free. Simply buy at any point below the current price and sell at any point above.
- Permit 8y ago> An arbitrage is just a strategy that's guaranteed to make money. If you know for sure that something will go up and down at different points you could make money risk free. Simply buy at any point below the current price and sell at any point above. This is not arbitrage. Also this is precisely the kind of strategy Taleb would have argued against in his book about black swan events.
- ikeboy 8y agoTime arbitrage is arbitrage. If someone was flipping a coin and raising their price when it landed heads and lowering it when tails, arbitraging using reversion to the means would be a perfectly legitimate arb strategy. Taleb's argument is that Silver's estimates are based on random noise, and are thus vulnerable to this form of arbitrage.
- lolc 8y ago
- ummonk 8y agoThat isn’t arbitrage. Arbitrage entails making a guaranteed profit, not relying on predictable fluctuations.
- davidmanescu 8y agoSilver's forecasts do predictably change, more precisely in that they swing deterministically in favour of one candidate whenever the most recent poll to come in favours that candidate heavily. Each time the probability drops below 40% (in your example) it is likely because the fair odds swung in the latest polls. To attempt to take advantage of this is to ignore the recent evidence (conditional upon that evidence being quite different to the current concensus). It's not at all unreasonable to do so, but isn't arbitrage. What if all polls started being increasingly conclusive leading up to election? 40, 39, ..., 0. No surprises and no arbitrage. Perhaps another way to express this critique of Silver's methodology is that it lends too much weight on recent outlier observations? Sure if you knew this you could profit off these swings, but making the arbitrage argument doesn't add much to the discussion to my mind.