4 ms·

Actually, I believe when there are a million people involved it's actually easier. As long as you have access to good data that is.

denzil_correa 14y ago
As long as you have access to good data that is. This is very difficult in itself. Even once you have it; it is not easy. More data does not lead to better prediction. It's a fallacy which has been proven wrong time and again.
- dbaupp 14y ago
  I hope you mean "having more data doesn't lead to better prediction automatically", because, used correctly, it always gives more accurate predictions (e.g. prediction intervals[1] are smaller, one can make better determinations about the distribution of the underlying population, etc). [1]: https://en.wikipedia.org/wiki/Prediction_interval https://en.wikipedia.org/wiki/Prediction_interval
  - denzil_correa 14y ago
    Let me me correct my statement. More data does not necessarily lead to better prediction. I must add that it is not always about usage as well. In some cases, the data is insufficient to make any kind of prediction.
    - dbaupp 14y ago
      The only data that is insufficient to make a prediction is either no data at all, or data suspected to be wrong (e.g. faulty observation equipment). Even given a single sample, one can make a prediction of what the next observation will be: the same value. Once you get more samples and more knowledge about the subject, you can bring stronger statistical tools to bear to get error estimates, prediction intervals, improved models, etc.
      - denzil_correa 14y ago
        > Once you get more samples and more knowledge about the subject, you can bring stronger statistical tools to bear to get error estimates, prediction intervals, improved models, etc Like I said earlier, increase in data does not always lead to improved models.
        pfortuny 14y ago
        If you have enough data, you have a census and then there is no model, just reality... In polls like this, the more data the better as long as it is unbiased (i.e. as long as it is DATA).

denzil_correa 14y ago

As long as you have access to good data that is. This is very difficult in itself. Even once you have it; it is not easy. More data does not lead to better prediction. It's a fallacy which has been proven wrong time and again.

dbaupp 14y ago
I hope you mean "having more data doesn't lead to better prediction automatically", because, used correctly, it always gives more accurate predictions (e.g. prediction intervals[1] are smaller, one can make better determinations about the distribution of the underlying population, etc). [1]: https://en.wikipedia.org/wiki/Prediction_interval https://en.wikipedia.org/wiki/Prediction_interval
- denzil_correa 14y ago
  Let me me correct my statement. More data does not necessarily lead to better prediction. I must add that it is not always about usage as well. In some cases, the data is insufficient to make any kind of prediction.
  - dbaupp 14y ago
    The only data that is insufficient to make a prediction is either no data at all, or data suspected to be wrong (e.g. faulty observation equipment). Even given a single sample, one can make a prediction of what the next observation will be: the same value. Once you get more samples and more knowledge about the subject, you can bring stronger statistical tools to bear to get error estimates, prediction intervals, improved models, etc.
    - denzil_correa 14y ago
      > Once you get more samples and more knowledge about the subject, you can bring stronger statistical tools to bear to get error estimates, prediction intervals, improved models, etc Like I said earlier, increase in data does not always lead to improved models.
      - pfortuny 14y ago
        If you have enough data, you have a census and then there is no model, just reality... In polls like this, the more data the better as long as it is unbiased (i.e. as long as it is DATA).