3 ms·
A fully illustrated article [1] And Lilian Weng blog on self-supervision [2] .. CPC is .. translating a generative modeling problem to a classification proble
by yazr 7y ago
A fully illustrated article [1]
And Lilian Weng blog on self-supervision [2]
.. CPC is .. translating a generative modeling problem to a classification problem... uses cross-entropy loss to measure how well the model can classify the “future” representation amongst a set of unrelated “negative” samples...
[1] https://ankeshanand.com/blog/2020/01/26/contrative-self-supervised-learning.html https://ankeshanand.com/blog/2020/01/26/contrative-self-supe...
[2] https://lilianweng.github.io/lil-log/2019/11/10/self-supervised-learning.html#contrastive-predictive-coding https://lilianweng.github.io/lil-log/2019/11/10/self-supervi...
- jjoonathan 7y agoThanks!