4 ms·
GPT, CLIP, Dalle, RLHF, these are all novel
by jerpint 3y ago
GPT, CLIP, Dalle, RLHF, these are all novel
- qumpis 3y agoRlhf wasn't introduced by openai. And GPT is a pretty standard transformer, no? Yes they did it at scale and it speaks volumes on their production skills, but OP was asking about research
- jerpint 3y agoGPT is a specific instantiation of a transformer, and doing next token prediction was an openAI thing. Transformers were a big part of it, but GPT was def proposed but openAI