3 ms·
Time to share my favorite quote from Symbols, Signals and Noise by John R. Pierce, where he discusses how Shannon achieved a breakthrough in Information Theory:
by rectang 2y ago
Time to share my favorite quote from Symbols, Signals and Noise by John R. Pierce, where he discusses how Shannon achieved a breakthrough in Information Theory:
> This chapter has had another aspect. In it we have illustrated the use of a novel viewpoint and the application of a powerful field of mathematics in attacking a problem of communication theory. Equation 9.3 was arrived at by the by-no-means-obvious expedient of representing long electrical signals and the noises added to them by points in a multidimensional space. The square of the distance of a point from the origin was interpreted as the energy of the signal represented by a point.
> Thus a problem in communication theory was made to correspond to a problem in geometry, and the desired result was arrived at by geometrical arguments.
- CoastalCoder 2y agoAnyone know if Pierce's book (dated 1961) is still a good intro to the topic? My background is in CS, and this would just be evening reading out of general interest.
- hotspot_one 2y agoI would be willing to read a few chapters just on spec. There is real value in understanding how people used to think about a problem, and where the source ideas came from.