3 ms·
In the 90’s and 2000’s we called it unsupervised learning. In fact there is a direct formal equivalence between many so-called self supervised learning techniq
by ml-anon 3y ago
In the 90’s and 2000’s we called it unsupervised learning.
In fact there is a direct formal equivalence between many so-called self supervised learning techniques and matrix factorization. And literally no one would claim that matrix factorisation is anything other than unsupervised.
Similarly Yann makes such a big deal about not doing contrastive learning when contrastive methods and his JEPA nonsense can also be shown to be formally equivalent. He’s a grifter like the rest of them. There’s a reason why he basically holds no power at Meta and hasn’t been in charge of AI research there in a long time.