5 ms·
In other words, what was actually observed?
by DiabloD3 10y ago
In other words, what was actually observed?
- lottin 10y agoThe stochastic process that generated the observed data.
- irremediable 10y agoNot really. What is observed is data, not a model/distribution. One can fit a given model to this data, but they do not, on their own, tell you which model generated them.
- enthdegree 10y agoMaybe you've gotten it but I don't know. Here is a maybe over-tired coin-flipping example: Say you have a coin that might be unfair, and you want to estimate its bias. You flip it a bunch of times, and it mostly lands heads. Predictions of the coin's bias based on this observed data are usually going to be that it's biased some % towards heads. (unless maybe you have a strong prior, but that's a different topic) But there is also a chance that really the coin is fair, or even biased towards tails and you just got unlucky in your flips. There's a mismatch between the true model (the coins actual bias) and the observed data (the result of your flips) because of this chance of `unluckiness'
- nabla9 10y agoNo. "true model", "true distribution" and "true population" is what generates the data.
- jsprogrammer 10y agoWhich is a misnomer, because the data probably isn't generated by a model.
- tomrod 10y agoSemantics at this point. Data-generating process is a term that's also used. A model seeks to mimic or match the real process to a reasonable approximation. Hence "true model" as a scoring engine or data relationship that represents reality completely.
- jsprogrammer 10y agoExcept that we can't access reality completely. Assuming that there is a "true model" generating data is just that: an assumption with no real basis. Semantics is the essence of communication.
- pessimizer 10y agoUnless you have data, that is. The data is the basis for assuming that a process has generated data. Either that, or the data has existed for all eternity, and therefore could never have been collected.
- jsprogrammer 10y ago"data" is your own perception, however. Can you give an example of a data generating process?
- tomrod 10y agoWe can create them! Suppose I take the function y = log(x) and add random white noise. The function log() and the parameters on the random white noise process are the data generating process. We could then fit a model y = \beta X + \epsilon, and then compare the "true" (first) model to our second model. When the natural world generates our data, the idea behind all this is the same: there is a process which generates the data, and the data reveals information about that process to an approximate degree. Some reads: [1] http://www.rimini.unibo.it/fanelli/econometric_models2_2012.pdf http://www.rimini.unibo.it/fanelli/econometric_models2_2012.... [2] https://en.wikipedia.org/wiki/Data_generating_process https://en.wikipedia.org/wiki/Data_generating_process