6 ms·
"Since Silver’s forecasts begin with probability models, it’s safe to assume they obey all the rules, including Bayes’, and would be arbitrage-free." I'll do t
by jerf 8y ago
"Since Silver’s forecasts begin with probability models, it’s safe to assume they obey all the rules, including Bayes’, and would be arbitrage-free."
I'll do the author the courtesy of assuming they've got a more expanded version of their argument in their head and just failed to express that, but I don't think that follows at all. I don't think there's a constraint on "Nate Silver has a probability model" that mathematically guarantees "Nate Silver's probability model" is correct, in any sense of that term. One could certainly provide evidence and/or proofs that Nate Silver's model follows those rules, but I don't think it just goes without saying. If nothing else the model could contain an straight-up error; goodness knows that's easy enough.
(If one wishes to add to the concept "probability model" that it must be correct by definition, than I can't accept the statement "Nate Silver has a probability model" with mathematical levels of confidence. He claims to have one, yes, but that's a long way from a proof.)
- baddox 8y ago> I don't think there's a constraint on "Nate Silver has a probability model" that mathematically guarantees "Nate Silver's probability model" is correct If I'm understanding the article correctly, it's not talking about models being "correct," it's just talking about the probabilities of all the outcomes adding up to 100%, which means you can't place a bet that guarantees you make money regardless of the outcome. In other words, offering a bet that was based on the claim that there is a 99% chance of rain today in the Atacama Desert, and a 1% chance of no rain there, is arbitrage-free. It's still clearly a poor probability model for one of the driest places on Earth, but it's arbitrage-free.
- ska 8y agoYes, that's exactly what they mean.
- ikeboy 8y agoIf over time, your forecasts predictably change, then you can be arbitraged. If e.g. I know that you'll have a probability below 40% at some point in the future, and I know you'll have a number above 41% at some point in the future, then it's trivial to create a strategy over time that is guaranteed to make money. Taleb's claim, as I understand it, is that Silver is incorporating random noise into his model and so will exhibit such predictably swings, which enables arbitrage.
- andrewla 8y agoSo what you're saying, I guess, is that Silver, by dint of making point probability predictions, is offering a two-sided market with infinite liquidity trading at that value for a binary option, and you could make arbitrage gains by trading off of volatility? I'm having a fair bit of trouble picking up that from either Taleb's or Clayton's article, but let's say that it's a fair assessment. Is the complaint that the observed variance is high enough to enable these arbitrages? So in order to make his model arbitrage-free, Silver would have to provide a spread rather than a point price, with his forecast as the midpoint of the spread, and the width of the spread wide enough that .5 is always inside the spread, thus making the forecast economically useless? Or is it that Silver does not provide error bars that would estimate that uncertainty? Or is it that because of intrinsic uncertainty in the election?
- ikeboy 8y agoWell obviously Silver isn't actually offering to bet at those odds. But complaining that a model is incorrect because it enables arbitrage is a standard complaint, it's how you can prove all non-Bayesian models are irrational. That doesn't mean all Bayesian ones automatically pass the test though. Error bars and spreads are already outside the Bayesian paradigm, which demands a single number.
- et2o 8y agoCurious about this. > It's how you can prove all non-Bayesian models are irrational Can you expand or link? > Error bars and spreads are already outside the Bayesian paradigm, which demands a single number Not following at all. What do you mean?
- ikeboy 8y agohttps://plato.stanford.edu/entries/epistemology-bayesian/supplement2.html https://plato.stanford.edu/entries/epistemology-bayesian/sup... >Not following at all. What do you mean? One assumption is that given a bet, you must choose to take a side of it. If you won't bet for something at X%, you must bet against it at 1-X%.
- deleted 8y ago[deleted]
- iainmerrick 8y agoI thought that bit was very well-expressed. Let’s see if I can explain what I think I understood by it... If you’re buying and selling bets on a range of events, you can only be immune from arbitrage if all your bets are mutually consistent. For example, if you’re offering 3:1 odds on event X, you can’t offer more than 1:3 on the complementary event ~X (where exactly one of X and ~X must happen). That’s pretty obvious, but there a lot of much trickier variations. “Nate Silver has a probability model” just means his forecasts are derived from a self-consistent model about the probabilities of all the micro-events that make up the election. That fits with the information FiveThirtyEight have published about their methods, so it seems correct to me. One way Silver’s model could be invalid is if there’s just a bug, and a single event is tracked in multiple inconsistent ways. For example, if the model unknowingly projected odds for the same politician in both the presidential election and a senate seat, without accounting for the fact that you can’t win both at once. But if that’s the criticism Taleb is making, he should be able to put his finger on a specific bug, which he doesn’t seem to have done. Another way Silver could be wrong is if his models are far too volatile, so you know if the probabilities shoot up or down a long way they’ll almost certainly revert to the mean again. I imagine you could run arbitrage against that. It’s far from clear that that’s the case, though. It could be that his models are volatile but still pretty close to reality, in which case just betting against every big swing in Silver’s model would be like trying to make money by predicting day-today movement on the stock market.
- dalore 8y agoIsn't Taleb arguing that his model comes being modeled during periods of relative calm. So when the black swan event does happen, that wasn't priced in as a possibility at all, creating an arbitrage there.
- iainmerrick 8y ago“his model” meaning Silver’s model? That sounds like it might be right. I think another commenter here correctly identified that it’s a misunderstanding -- Silver’s model estimates “the election result of the election were to happen tomorrow”, so unlikely events in the coming months don’t need to be accounted for by definition. If so, I think there’s a valid criticism that the “now-cast” notion is a bit deceptive, and also impossible to validate (we’ll never know what that hypothetical election result would actually have been).
- MR4D 8y agoTaleb is basically saying that Nate's model is not internally consistent. I tend to agree, but the name-calling is a bit much.