3 ms·
fair point — OpenAI's original plan literally said "solve unsupervised learning". the self-supervised distinction wasnt really standard til after BERT/GPT popul
by cold_harbor 4mo ago
fair point — OpenAI's original plan literally said "solve unsupervised learning". the self-supervised distinction wasnt really standard til after BERT/GPT popularized it
- jmalicki 4mo agoI think it's an extremely important distinction because self supervised learning has real inherent reward signals. Something like clustering does not.