5 ms·
> You're arguing past each other. The amount of information transmitted is 1 bit. I don't understand the argument here. In order to get up to one bit of infor
by thaumasiotes 6y ago
> You're arguing past each other. The amount of information transmitted is 1 bit.
I don't understand the argument here.
In order to get up to one bit of information, you need to take account of the fact that "yo" is only sent at particular times. If you ignore that fact, sending "yo" provides exactly zero bits of information, because it is the only possible message. All of the information content comes from the existence of the message; none of it comes from the contents.
So in order to claim that there's any information present at all, you have to admit that time of sending carries information. The amount of information carried then depends on the duration over which messages might have been transmitted, since that possibility is what imbues information into messages that are transmitted. It also imbues information into messages that aren't transmitted, unless you believe that a binary message of 01000110 transmits just 3, and not 8, bits of information.
- stevenhuang 6y agoIt's called a side channel. The amount of information _sent_ really is 1 bit.
- thaumasiotes 6y ago> The amount of information _sent_ really is 1 bit. I'm not sure how you're calculating this, but it is obviously wrong. The information conveyed by the contents of a message is the log of the number of possible messages. Here, there is one possible message. The log of one is zero. There's a big difference between one bit of information and zero. You can interpret a "yo" message as conveying one bit of information, and the only way to do that is to draw it from the contrast between "sending a yo" and "not sending a yo". If you do that, "sending a yo" sends one bit of information, and "not sending a yo" also sends one bit of information. Thought experiment: with three bits of information, you can disambiguate between eight possibilities. Try to design a protocol in which, by sending up to three "yo"s, you achieve 8 distinct messages.
- stevenhuang 6y agoAgain, what you're talking about is the side channel. Shannon entropy in particular. Of course you can encode information up to the time granularity, but if you're talking about that then you're not talking about the content in transmission anymore--which we are--hence why you and others are confused why we're saying it's still 1 bit. If you want to get into the topic of Shannon entropy, then that's another conversation.
- thaumasiotes 6y ago> then you're not talking about the content in transmission anymore--which we are--hence why you and others are confused why we're saying it's still 1 bit. You're the one who's confused. Show me how you get more than zero bits out of the content in transmission. If you actually try to work this out, you will notice immediately that it can't be done.
- stevenhuang 6y agoYou're indeed right. Log base 2 of 1 is 0. I thought you were continuing OPs line of thought and arguing the message contained even more bits of information.
- aeternum 6y agoIf you claim that time is a side channel then the information _sent_ is really 0 bits. You cannot change the message.
- stevenhuang 6y ago0 bits is right! My main point was about the side channel so I just took their word on that.