2 ms·
GPT wouldn't have even been possible, let alone take off, without self supervised learning.
by charcircuit 1y ago
GPT wouldn't have even been possible, let alone take off, without self supervised learning.
- mountainriver 1y agoRLHF is what gave us the ChatGPT moment. Self supervised learning was the base for this. SSL creates all the connections and RL learns to walk the paths
- charcircuit 1y agoThe easy to use web interface gave us the ChatGPT moment. Take a look at AI Dungeon for GPT2. It went viral due to making using GPT2 accessible.
- mountainriver 1y agoNo RLHF did, we already had interfaces to GPT like Jasper