2 ms·
The hype ratio between GPT2 and GPT3 is much higher than the hype ratio between GPT3 and GPT4. If we project this into the future then the hype ratio will be ev
by imtringued 4y ago
The hype ratio between GPT2 and GPT3 is much higher than the hype ratio between GPT3 and GPT4. If we project this into the future then the hype ratio will be even lower between GPT4 and GPT5. The key innovation was RLHF and everything since then has been incremental improvements.