2 ms·
Kolmogorov Complexity looks interesting. It seems to formalize Occam’s Razor and the notion that intelligence = compression.
by prideout 3mo ago
Kolmogorov Complexity looks interesting. It seems to formalize Occam’s Razor and the notion that intelligence = compression.
- Lerc 3mo agoI wouldn't say so about Occam's Razor which is a heuristic. The relationship between compression and intelligence, while not equal is definitely there. It looks like 3Blue1Brown is going to be doing some videos on this aspect.
- nextaccountic 3mo agothere's a way to connect kolmogorov complexity and occam's razor, which is solomonoff induction
- Destructotor 3mo agoIf you find this interesting, you should look into Solomonoff induction. It combines Kolmogorov complexity with Bayes rule to provide a general framework for inductive inference, and naturally formalizes Occam's razor.