3 ms·
I don't see the connection. Parsimony is important for induction by defining a universal prior. Solomonoff induction formalized this notion by ordering all prog
by naasking 10y ago
I don't see the connection. Parsimony is important for induction by defining a universal prior. Solomonoff induction formalized this notion by ordering all programs that could generate a particular set of observations by increasing Kolmogorov complexity.
- mannykannot 10y agoAre you not conflating 'things that make problems tractable' with 'things that must be'?
- naasking 10y agoI don't see how. Firstly, Kolmogorov complexity is incomputable, so it's not technically tractable, it's merely an idealised induction process. Secondly, assigning a higher probability to an outcome isn't saying that how things are.
- mannykannot 10y agoCorrespondingly, no claim about the likelihood of an infinite hierarchy of functions is saying how things are.
- naasking 10y agoWhich I didn't say, I simply said it was unlikely. In fact, vanishingly unlikely because it relies on infinity.
- deleted 10y ago[deleted]
- mannykannot 10y agoYou might not have written it in exactly those words, but the corollary of your observation still holds.
- naasking 10y agoSaying that an infinite hierarchy of functions is unlikely is saying that we probably don't live in a world governed by an infinite hierarchy of functions. But that's all it says, and as I pointed out, we have good a priori reasons for believing this conclusion, without having to ontologically commit ourselves to accepting it as necessarily true. So I disagree, it's still not conflating "things that are likely" with "things that are".