Part of the answer: https://en.wikipedia.org/wiki/Shannon%27s_source_coding_theorem https://en.wikipedia.org/wiki/Shannon%27s_source_coding_theo... You could a

Part of the answer: https://en.wikipedia.org/wiki/Shannon%27s_source_coding_theorem https://en.wikipedia.org/wiki/Shannon%27s_source_coding_theo... You could also think about lossy compression that is indistinguishable from lossless for the human eye, then you get another (lower) lower bound.