For anyone interested in the idea of compression as learning combined with neural nets, a random list of interesting work: 1. Schmidhuber's classical work appl

For anyone interested in the idea of compression as learning combined with neural nets, a random list of interesting work: 1. Schmidhuber's classical work applying a time-based Kolmogorov complexity to neural nets https://pubmed.ncbi.nlm.nih.gov/12662875/ https://pubmed.ncbi.nlm.nih.gov/12662875/ 2. Applying a form of Kolmogorov complexity to learn formal languages using RNNs https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00489/112499/Minimum-Description-Length-Recurrent-Neural https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00489... 3. Hinton and Van Camp - Keeping the neural networks simple by minimizing the description length of the weights https://dl.acm.org/doi/10.1145/168304.168306 https://dl.acm.org/doi/10.1145/168304.168306