3 ms·
I can't give a concrete reason, but I suspect they might want to be able to transmit over channels with comparatively little bandwidth/much noise. Shannon taugh
by kqr 6y ago
I can't give a concrete reason, but I suspect they might want to be able to transmit over channels with comparatively little bandwidth/much noise. Shannon taught us that more reliable communication in the face of low bandwidth and/or high noise is only possible with a smaller symbol set.
- Dylan16807 6y agoI could see that in some extraordinarily niche scenarios but if someone has the bandwidth to be transmitting full news articles then they have the bandwidth to use a whole 7 bits per character. And they should be compressing it too, at which point you don't need to restrict less common characters.
- kqr 6y agoThe set of people at the wire transmitting full articles might be different from the set publishing brief facts from low-bandwidth locations. (But it is convenient if they use the same infrastructure for it!) I'm not convinced they would be compressing it. When you have the bandwidth for a full article, size is probably not going to be the problem, and when you don't have the bandwidth, compression is probably counterproductive.
- Dylan16807 6y agoCompression of text is basically never counterproductive as long as you use a suitable design. Even a static huffman tree would help, and has no overhead. An entropy encoder would do very well and only cost a few bits to flush.
- kqr 6y agoCompression removes redundancy. It's literally the definition of compression! And reduced redundancy is always bad when reliable transmission is a priority over small size.
- Dylan16807 6y agoIf your news wire starts mangling data, you need to resend it, not guess. And I bet you can get more reliability out of compressing and then adding error correction bits.
- kqr 6y agoBit of a late reply, but resending it is a form of redundancy, and so is adding error correction bits. It is cheaper to do these things (they require less bandwidth) when you start with a limited character set.
- BlueTemplar 6y agoHow do journalists using a non-latin-based alphabet do it ?