> Predictive coding is the idea that BNNs generate a mental model of their environment and then transmit only the information that deviates from this model. Pre

> Predictive coding is the idea that BNNs generate a mental model of their environment and then transmit only the information that deviates from this model. Predictive coding considers error and surprise to be the same thing. This reminds me of a Slate Star Codex article on Friston[1]. [1] https://slatestarcodex.com/2018/03/04/god-help-us-lets-try-to-understand-friston-on-free-energy/ https://slatestarcodex.com/2018/03/04/god-help-us-lets-try-t...