4 ms·
Information theory is one of very few things out of academia that has really stuck with me and shaped how I look at problems in the world. The current applicati
by bob1029 6y ago
Information theory is one of very few things out of academia that has really stuck with me and shaped how I look at problems in the world. The current applications for it are so vast and immediate that I wonder how many other places it could still be applied to.
Being able say and practice things like "now let's consider what this might look like in the frequency domain..." can open up radical new approaches to solving problems. "Ohhhh that signal/channel has a hard roll-off starting at 20khz... I probably need to increase/decrease my sample rate accordingly" vs flying blind with traditional time domain analysis. In practical terms, frequency domain work is mandatory for things like high-efficiency video or audio codecs.
Understanding what entropy vs information really means is a huge part of being able to competently build cryptographic primitives from first principles.