3 ms·
Houshalter: the no-free-lunch theorem assumes that all possible "real world" problems are equally probable. That does not appear to be true in theory (due to t
by cs702 10y ago
Houshalter: the no-free-lunch theorem assumes that all possible "real world" problems are equally probable. That does not appear to be true in theory (due to the laws of physics, e.g., see https://arxiv.org/abs/1608.08225 https://arxiv.org/abs/1608.08225 ) nor in practice (e.g., in complicated AI-type problems, the objects of interest always seem to lie on/near lower-dimensional manifolds embedded in a high-dimensional input space).
- whatshisface 10y ago>...the objects of interest always seem to lie on/near lower-dimensional manifolds embedded in a high-dimensional input space. Maybe that's because reality is high-dimensional but our brains can only classify interesting things on or near a lower-dimensional manifold.
- Eridrus 10y agoDespite the difficulty of solving tasks humans are good at, we also want machines to solve tasks that are impossible for humans to solve, so I don't think this is really a general argument against no free lunch.