4 ms·
> Also, it is far from clear what entropy exactly means – let alone how it can be measured in the brain This is a gripe I have with modern information theory a
by illuminant 2y ago
> Also, it is far from clear what entropy exactly means – let alone how it can be measured in the brain
This is a gripe I have with modern information theory and how it is taught. Modern information theory says that entropy is related to the number of possibilities in a system (gleaned from Shannon's example of the electron valence.) I INSIST however that the only accurate definition of entropy is the distribution of potential over negative potential (whether heat or information or electron valence, that is the phenomenon.) you can see, more neural connections does mean more possible outcomes yet it does not have anything (in this case) to do with calculating probability based on the distribution of possibilities (see?) for the record true entropy contains all anticipated possibilities IN ADDITION TO those not anticipated, such as cosmic rays, or dumb luck, or physiological breakdown, or whatever. Not just known options.