4 ms·
True model is the probability distribution that generates the observed data.
by nabla9 10y ago
True model is the probability distribution that generates the observed data.
- DiabloD3 10y agoIn other words, what was actually observed?
- lottin 10y agoThe stochastic process that generated the observed data.
- irremediable 10y agoNot really. What is observed is data, not a model/distribution. One can fit a given model to this data, but they do not, on their own, tell you which model generated them.
- enthdegree 10y agoMaybe you've gotten it but I don't know. Here is a maybe over-tired coin-flipping example: Say you have a coin that might be unfair, and you want to estimate its bias. You flip it a bunch of times, and it mostly lands heads. Predictions of the coin's bias based on this observed data are usually going to be that it's biased some % towards heads. (unless maybe you have a strong prior, but that's a different topic) But there is also a chance that really the coin is fair, or even biased towards tails and you just got unlucky in your flips. There's a mismatch between the true model (the coins actual bias) and the observed data (the result of your flips) because of this chance of `unluckiness'
- nabla9 10y agoNo. "true model", "true distribution" and "true population" is what generates the data.
- jsprogrammer 10y agoWhich is a misnomer, because the data probably isn't generated by a model.
- tomrod 10y agoSemantics at this point. Data-generating process is a term that's also used. A model seeks to mimic or match the real process to a reasonable approximation. Hence "true model" as a scoring engine or data relationship that represents reality completely.
- jsprogrammer 10y agoExcept that we can't access reality completely. Assuming that there is a "true model" generating data is just that: an assumption with no real basis. Semantics is the essence of communication.
- pessimizer 10y agoUnless you have data, that is. The data is the basis for assuming that a process has generated data. Either that, or the data has existed for all eternity, and therefore could never have been collected.
- jsprogrammer 10y ago"data" is your own perception, however. Can you give an example of a data generating process?
- tomrod 10y agoWe can create them! Suppose I take the function y = log(x) and add random white noise. The function log() and the parameters on the random white noise process are the data generating process. We could then fit a model y = \beta X + \epsilon, and then compare the "true" (first) model to our second model. When the natural world generates our data, the idea behind all this is the same: there is a process which generates the data, and the data reveals information about that process to an approximate degree. Some reads: [1] http://www.rimini.unibo.it/fanelli/econometric_models2_2012.pdf http://www.rimini.unibo.it/fanelli/econometric_models2_2012.... [2] https://en.wikipedia.org/wiki/Data_generating_process https://en.wikipedia.org/wiki/Data_generating_process
- unfamiliar 10y agoNo, the "true model" he seems to be referring to is the mean of the distribution of the noisy observations. In the example, the distribution is the normal distribution and the mean is log(x), which he is referring to as the "true model". The notation is pretty sloppy for someone handing out statistical advice.
- nabla9 10y agoI don't think his usage of these terms is sloppy at all. The main point of his argument is that R² compares to observed mean and not into true model behind the data. Terms "true model", "true distribution" and "true population" are well defined concepts in statistics – unless Jorma Rissanen is nearby.
- bunderbunder 10y agoThe true model is y = log(x) + u Where u is an error/noise term, and in this case takes a normal distribution. The error term is meant to Hoover up all the stuff you can't account for because it's impossible to measure everything. As ever, what you're trying to estimate is the parameters for everything but the error term. He's maybe being a little sloppy with the notation, but TBH it's a pedantic distinction that I haven't seen anyone make a big deal of since I last took intro stats. In R, for example, you'd specify the model as "y ~ log(x)" and leave it at that.