usual disclaimer: you decide on your own whether I'm an insider or not :) where LeCun might be prescient should intersect with the nemesis SCHMIDHUBER. They ca

usual disclaimer: you decide on your own whether I'm an insider or not :) where LeCun might be prescient should intersect with the nemesis SCHMIDHUBER. They can't both be wrong, I suppose?! It's only "tangentially" related to energy minimization, technically speaking :) connection to multimodalities is spot-on. https://www.mdpi.com/1099-4300/26/3/252 https://www.mdpi.com/1099-4300/26/3/252 To Compress or Not to Compress—Self-Supervised Learning and Information Theory: A Review With Ravid, double-handedly blue-flag MDPI! Sunmarized for the layman (propaganda?) https://archive.is/https://nyudatascience.medium.com/how-should-self-supervised-learning-models-represent-their-data-8d9ca64ff8d9 https://archive.is/https://nyudatascience.medium.com/how-sho... >When asked about practical applications and areas where these insights might be immediately used, Shwartz-Ziv highlighted the potential in multi-modalities and tabula Imho, best take I've seen on this thread (irony: literal energy minimization) https://news.ycombinator.com/item?id=43367126 https://news.ycombinator.com/item?id=43367126 Of course, this would make Google/OpenAI/DeepSeek wrong by two whole levels (both architecturally and conceptually)