2 ms·
Intelligence is actually correlated with the ability to simplify complicated things. Occam's razor. Compression as comprehension.
by puttycat 1mo ago
Intelligence is actually correlated with the ability to simplify complicated things. Occam's razor. Compression as comprehension.
- gruntled-worker 1mo agoWe're not asking the model to simplify something, we're asking it to perform a task. Its subtle preferences show up as an overcomplicated path to the goal. In some cases, there are also nuances that we don't pick up on. Here it's our preference for simplification that's showing up. We set the lossy compression factor higher than it does.