4 ms·
Here are two different ways of thinking about it which IMO are quite convincing: - If you had a reliable way to losslessly compress any N bits of information i
by FartyMcFarter 4y ago
Here are two different ways of thinking about it which IMO are quite convincing:
- If you had a reliable way to losslessly compress any N bits of information into N-1 bits of information, you could use this iteratively to compress N bits into N-1 bits, then into N-2 bits, then N-3 bits, and so on until you've compressed anything into 1 bit of information. This is obviously ridiculous, so the initial assumption that we have such compression can't be true.
- Alternatively, try for yourself to make a function that maps 4 objects into 2 objects. Say mapping the input space "red, green, blue, or yellow" into the output space "white, or black". You won't be able to make this function reversible no matter what you do - it's easy to demonstrate by brute force as you can try all possible functions. If your input space is 2, your output space is at most 2, not 4. You can extend the same intuitive idea to prove that N bits of information can't always be compressed into N-1 bits by the same method.